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constitute a consensus 6elf*portrait. Next, data on the research 
utilization networks of two of the units were obtained froa 
questionnaires. Subsequently, two interface conferences vete convened 
involving sub^saaples of those surveyed in the network study. A 
theoretical aodel was then developed to describe a resource-user 
problea^solving dialogue within which it was possible to analyze all 
functions and activities of diffusion and utilization agencies. 
Coaaunication network aaps were drawn to depict the types and flow of 
inforaation. Hajor findings were that: 1) research inforaation was 
rarely sought in crises; 2) attitudes toward disseaination and 
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^'user^centering,'* "Besearch Developaent** and "capacity**; and 3) the 
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Several federal agencies have set up special units concerned with the dif- 
fusion and utilization (D&U) of the research they have sponsored. Activities of four 
auch D&U units vere studied: (1). Division of R&D Utilization, Manpower Administration, 
Dept* of Labor, (2) National Institute for Education, Office of Education, DHEW, (3) 
lasearch Utilisation Branch, Social and Rehabilitation Service, DHEW, and (4) Mental 
Health Services Developinent Branch, National Institute of K^mtal Health, DHEW« Cob- 
paratlve functional profiles of each unit were develoi;>ed, based on extended staff 
Interviews, and revised to constitute a consensus "self-portrait/' In a second phase 
of the projects data on the research utilization networks of two of the units were ob- 
tained through mailed questionnaires* Subsequently two "Interface conferences" were 
convened Involving sub-samples of those surveyed In each network study* The authors 
develop a theoretical model which describes a resource-user problem-solving dlalogua 
vlthln which it is possible to analyze all functions and activities of D&U agencies. 
Comnunication network maps are presented which include types of Information, media, 
and flw among key sub-groups* Other findings: (1) research information is rarely 
used or sought in crisis situations, (2) attitudes toward D&U are dominated by 
four Ideologies termed "linkage," "user-centering," "RD&D," and "capacity"; (3) the 
most Important procedural elements in the D&U system and the most cited targets for 
system Improvement are (a) linkage , (b) adequate diagnoeie of the real user need^ 
and (c) careful plcmning and organizing of the DM ay a tern in that order* 
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CHAPTER I 

INTRODUCTION, SUMMARY, AND IMPLICATIONS 
K THE PROBL€H ^ 

A growing bo^ly of research and theiry Is helping us to understand how 
knowledge is diffused and utilized in the social system^ Major literature 
reviews by Rogers and Shoemaker (1970, Watson (1971) and Havelock (IS69), 
not only demonstrate an impressive empirical base but also provide useful 
frameworks or models which suggest- that a clear and comprehensive under- 
standing of these, phenomena is possible. 

The relevance of this growing corpus is especially evident when we 
examine the interface between pol icy makers and trve research community; 
federal managers are increasingly being asked tq mjake decisions about social 
research funding and social research uti 1 IzaMon, but they usually lack the 
relevant research and theory on which to base thefr decisions ^ It Is no 
longer a question of funding research , per se, but irore one of how to organize 
an RSD program for maximum pay-off. What projects are likely to have the 
most multiplier effects? What projects are likely to Impact mo^ positively 
on the sponsoring agency?. . .the academic communi ty7. • . the consunu^tg publ ic? 
What projects result In the most Impactful reports with the widest dissemina- 
tion and utilization? What projects produce the most positive and negative 
second order and long term donsequences? These are a few of the many questions 
which might pass through the head of a federal manager as he considers the ^ 
value of government sponsored social research. Most such questions in an 
ultimate sense are '•quality** questions, I.e., they seek to know which projects 
are *'^ood'' and "bad," "important" or "trivial," "useful" or "non-useful," 
"helpful" or "harmful." 

However, "quality" In the usual sense Is not the only important question 
to* ask about a research project. Increasingly we are becoming aware of the 
fact that "goodness" by itself does not guarantee utilization. For this reason 
several federal agencies have set up special Uni ts concerned with the diffusion 
and utilization (D&U) of the research which they have sponsored. Many of 
these D&U units have developed elaborate strategies of demonstration, network 
building, specialized coordinator roles, etc., on the assumption that such 
specialized mechanisms will accelerate the flow of knowledge. 

Some of these agencies have also supported applied research and evalua- 
tion studies on their own dissemination efforts in the hope of arriving at 
more effective stratjegles. For example, the National Aeronautics and Space 
Administra^tion has commissioned studies to evaluate its Technology Utilization 
prooram, (Arthur D. Little, 1965; Denver Research Institute, 1967) i and the 
Offlbe-of Naval Research has sponsored a stiidy of .the tra^fsfer and utilization 
of the behavioral research it has sponsored over a number af^years (Hackle 
and Christensen, 1967).- Such studies generally arrive* at dismal conclusions 
indicating the Inadequacy of various mediating and translatlrt^ mechini'sms, 
Ihe absence of human elements, "warm terminals" to negotiate the questions of 
potential users, and as often as not th^re is an underlying suspicion that 
the research or development work which is being "diffused" is si'mply not. 
relevant or useful to anypne. 



A few projects have also been undertaken to design and execute diffusion 
field "experiments'* In which particular ''good" or "excellent" projects are 
demonstrated and promoted In various ways (e.g., Falrweather, 1973; Glaser and Ros 
1971; Glaser, et al., 1966; Richland, 1965). Such studies have had mixed 
results but have been helpful In pointing out the. range of diffusion approaches 
v^hich can be undertaken and In demonstrating that such efforts can be 
documented and evaluated to determine what combinations of media and methods 
are. most effect i ve for particular target audiences. 

To date, however, there have been no studies which have attempted to 
relate federal diffusion strategy to a systematic body of research and theory 
such as represented by Rogers or Havelock. Moreover, no studies have so far 
compared D&U strategies across a number of agencies. The project on which 
we will report here was undertaken to fill this gap. Its aim has been to 
examine the strategies and assumptions of four agencies responsible for O&U 
programs to compare these strategies and assumptions with the patterns of 
flow and utilization which ultimately result from them. 

It may be easier to grasp the complexities of the research problem to 
which our study is addressed if we portray a number of the organizational 
elements in relation to each other graphically, as In Figure 1.1. This diagram 

[Insert Figure 1.1 here] 

shows several subsystems, with the research, funding, and client agencies 
playing the major role in the generation and flow of information. The model 
also sketches the linkages or communication paths between and among these 
subsystems. Tradl tiohaJ ly , In the days of "little science'' (Price, 1963) the 
research project or producer himself was the center of three fundamental 
research processes: the instigation or motivation for conducting research, 
the actual conduct of inquiry and discovery, and the dissemination of results. 
The model In the flgure^shows where we have coit^ since; with the growth of 
"big science" the three functions may now be divided among three different 
systems: funding eouroea may instigate and sped fy the type of research to be 
done; diffusion agenoiee may make the results known; while the reaearoh agency 
still retains Its traditional role of discovery. The splitting of roles 
Is itself a consequence of the growth of science, one which has resulted 
in more complex structures and in the one central fact that the many different 
systems must now communicate effectively with each other I^n order for science 
to continue to produce utlllzable ai^d utilized knowledge. 

The figure also Indicates the principal organizational' affiliations of 
those who have had inputs to our data 'gather ing processes. ^ 
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Fl GURE 1 . 1 An Crgani zational Skeleton of Federal R&D 

Communication: One Pattern Emerging in the I960*s 




Note: Linkages between subsystems are represented by arrows, which may stand 
for either unl- or two-di rect lonal communication. For example, we have illustrated 
the research agency In contact with two clients directly; one of these has 
request and/or feedback coirmun icat ion with the research producer, while the 
other has no return link* 
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During the middle and late 1960*s while this configuration was emerging 
in several social problem areas, an informal inter-agency group wa^ organi2ed 
to discuss various aspects of dissemination and utilization policy and strat- 
egy. This lnter*agency seminar included interested persons from half a dozen 
agencies Including at various times specialists from the National Science 
Foundation, the Office of Economic Opportunity, the Department of Labor, and 
various agencies of the Department of Health, Education, and Welfare. Its 
meetings were held at irregular intervals with invited speaicers, representing 
various D&U research and theoretical perspectives; the list included most of 
the outside experts that each agency had separately relied on to help establish 
!ts own strategy, Including such persons as E. Glaser, R. Havelocic, R. LIppItt, 
W. Paisley, E. Rogers, and others. 

The seminar had the effect of creating an Invisible college of persons 
In and out of government with a common focus of Interest. Each agency had 
an opportunity to exchange with others on what strategies they were following, 
and at the same^ time they made their own research grantees and contractors 
aware of similar problems In other gpvernment agencies. 

The seminar was sustained priinarlly by the persistent Interest and effort 
of icey members of four of the agencies Involved, and It wa£ In large part for 
this reason that these four were approached with the idea of a comparative self 
diagnostic project and agreed to participate with some enthusiasm. Thus !n 
a real sense this project began Informal ly some years before the Manpower 
Administration awarded the contract to the University of Michigan which has 
made this report possible. Indeed,, the formal project was organized v«ith 
the clear expectation that It would revitalize the seminar and provide a basis 
for future discussions and mutual planning of Improvements in all four systems, 
and other systems which In the future might see fit to Join them. 

The four agencies which Joined In the project were: 

The Division of RsD Utilization, Mar ; Qwer 
Administration, Department of Labor. 

The National Center for Educational Communication 
(NCEC) , Office of Education, Department of Health, 
Education, and Welfare. 

/ ^ 

The Research Utilization Branch, SocTal and 
Rehabilitation Service, Department of Health, 
Education, and Welfare. 

The Mental Health Services Development Branch, 
National Institute of Mental Health, Department 
of Health, Education, and Welfare. 



b. 



c. 



and d. 



Such is the nature of things in a federal bureaucracy that some of these 
organizations underwent various transformations while we were studying them 
and then even while we were writing up our findings. Thus, as we write in 
the fall of 1973» the NCEC no longer exists as an organizational entity while 
Its functions and most of its staff have been absorbed in the newly created 
National institute of Education; most of the NCEC activities described in 
this report are being carried on at a maintenance level, but funding cutbacks 
are In prospect and the future direction of NIE D&U policy is uncertain. The 
SRS Research Utilization Branch was elevated to the status of "Division'* soon 
after our study began, but here, too, with another leadership upheaval, D&U 
policy is being reappraised once more and the future is equally uncertain. 
Other changes, of major and minor i port, have taken place in all four agencies » 
making the task of analysis more dirflcult and the speci f ic findings and 
descriptions inevitably somewhat dated. Hence, what we have here is a kind 
of snapshot taken at a point of time in the recent past when there were four 
agencies of government trying to do roughly the same kinds of things; it can 
provide some ideas of the range of activities which can form a part of a 
DSU strategy, but it is definitely not a handbook or an official representa- 
tion of what any of the agencies are now doing and plan to do in the future. 

The design and execution of the project was entirely the responsibility 

of the Michigan project team headed by Havelock and LIngwood, but it did work 

in regular consultation with each of the agency staffs and with the approval 

and support of a study group comprised of Judah Drob of the Department of 

Labor, Howard Davis of NIMH, Thomas Clemens of USOE (now of NIE), and George 
Engstrom of SRS. 

The original objectives as stated in the proposal were as follows: 

1. To examine and describe the assumptions and strategies 

of four federal agencies with regard to the dissemination 
and utilization of contracted research and development 
projects. 

2. To assess and compare perceptions of actual communication 
patterns and impact from diverse perspectives of sponsors, 

• researchers, and users. 

3. To create an opportunity for Inter-agency reflection 
and analysis of these policies and their effects. 

The great bulk of funding for the- project was provided by the Manpower 
Administration which also awarded the contract. Some funds weri« also trans- 
ferred to MA by the NCEC. 

because of the central role played by the Division of RS^l IJrilization 
in the Manpower Administration and by Its director, Judah Drob, In inspiring 
the project and assisting in its development, we have been at special pains 
to discuss implications in terms of application by that unit. On the other 
hand, as the stated objectives indicate, our prime purpose has been to shed 
lipht on the D&U process in general and to derive implications for managers 
of OSM at any level of government and in the private sector. 
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II. METHOD AND HISTORY 



The project was initially planned as a 15 month effort divided into 
three phases. The first phase would be diagnostic-descriptive* a documen- 
tation of what each unit was now doing or trying to do. It would be based 
on extended interviews with all staff in each unit and would lead to 
comparative '*prof i les.'' The second phase would consist of four parallel 
network surveys, sampUng from the subsystems represented in Figure 1.1, 
and eliciting perceptions of DsU process information needs, and suggestions 
for improvement. The survey data would be enriched and confirmed by the 
convening of four parallel ''interface conferences'' involving a sub-sample 
of representatives from each Figure 1.1 entity, involved in live interaction 
and reaction to the survey and Phase I findings. The third phase would 
involve analysis, write-up, and report back to the inter-agency seminar. 

Although this plan was followed in broad outline, it could not be 
implemented in all its dimensions due to a combination of ci rcurnstances. 
The following narration indicates in a little more detail the approach 
followed and the reasons for the changes in direction and emphasis that were 
made. 

A. PHASE I: THE AGENCY PROFILES 

Each of the federal agencies participating in this project had had a 
number of years' experience in planning and sponsoring dissemination and 
utilization activities, grants, and contracts based on research or develop- 
ment work previously funded by themselves or their parent agencies. Over 
these years of experience, a1 1 cooperating agencies had experienced both 
success and frustration in attempting to fulfill their mission and had 
arrived at reasonably well articulated rationales for their unit's current 
activity and general position as regards DSU. In the first phase of the project 
the CRUSK team interviewed key personnel from the units in depth to obtain a 
reasonably complete and uncritical portrait of each unit's operating philosophy. 
Once committed to paper, these descriptions were shared with each agency and 
checked for errors, mispercept ions , and general acceptability as accurate self- 
portrai ts. 

Collecting the information was simpte enough, and this aspect of Phase I 
was accomplished smoothly and on schedule. What proved more difficult was 
developing a coherent framework which would allow complete description and 
compccrieon of the four agencies, function by function. To this end, a model 
was developed and elaborated into a series of activity categories. 

A special meeting was then held with the four-member study group in 
Washington to review this schema and to add or revise segments of it so 
that a satisfactory fit could be made to each agency. In this manner some 
degree of consensus was achieved. 

' Subsequently _a 11 the descrl4)tlve- material from the agency ioterviews was 
coded Into each category of the agreed-upon schema to form detailed portraits 
which could be compared, function for function, in a sIde-by-side format, 
^ach detailed portrait was further checked for completeness and accuracy with 



all key members of each agency. The total cycle was far more time consuming 
and costly than had originally been conceived, although the study group 
members agreed that the approach followed was desirable and the product use- 
ful. The results of Phase I are reported in Chapter Three and Chapter Four. 

B, PHASE II: THE RESEAl^CH UTILIZATION NETWORKS 

The configurations of Figure \.\ suggested the necessity of examining 
D&U from many different perspectives if we were to understand what really 
takes place in the flow and utilization of research in a total systems 
context. In Phase I we had begun with the sponsor agency's perception of 
the structure and process it oversees. In Phase II we planned to examine 
DSU from the perspective of the other systems involved: those who actually 
produce research knowledge, those who disseminate it, and those who ultimately 
use it. 

Information on these different perspectives was to be gathered in two 
ways. First, we intended to interview representatives of each of the Figure 1.1 
subsystems to obtain their separate perceptions of how information flowed in 
the system, the roles played by different groups, the barriers and facilitators 
of utilization, and the strategies and procedures that were most effective and 
most widely practiced. The remainder of the data were to come from a conference 
of selected Informants from each subsystem. This conference was to be speci- 
fically designed to explore D&U patterns and interface problems among repre- 
sentatives of all four subsystems involved, as surfaced and implied by the 
i ntervlews. 

The original plan called, in effect, for four consecutive or parallel 
interview surveys followed by four con&ecutive or parallel conferences. 
With Phase I running behind schedule and absorbing a large share of the 
planned and authorized budget, these ambitious plans had to be modified. An 
effort was made, first of all, to augment the budget through contributions 
from each participating agency ( not including the Manpower Administration which 
had awarded the contract and had absorbed all costs up to that point). All 
study group members were in favor of contributing to the project, but none 
were able to respond.* This occurrence, in itself, is probably instructive 
in illustrating the difficulty of inter-agency collaboration on a formal basis 
even when strong informal interpersonal linkage exists and Is able to provide 
a strong rationale for action. 

In any case, the inevitable consequence of these events was a cut-back 
In project plans and an agreement to move forward with network surveys and 
conferences in two of the four agencies (MA and SRS). The interview proce- 
dure for the start-up of Phase II was also found to entail costs beyond the 
budget capability, and for this reason, a mailed questionnaire was substituted. 



*A modest contribution from NCEC was subsequently made via a transfer to 
MA but this was used to reduce the MA share rather than to augment the pro- 
ject. ^ 
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Separate sub-projects with separate budgets were then planned to complete 
Phase II work with NIMH and NCEC. With the demise of NCEC such plans 
proved unrealistic, but a formal proposal was submitted to NIMH with the 
encouragement of Dr. Davis. At this writing, no action has been taken. 
The major results of Phase I! are reported in Chapters Five and Six. 

C. PHASE III: INTEGRATiON, COMPARISON, REPORTING 

Particularly where new approaches are being taken, new methodologies 
tried, and new areas of knowledge explored, the interpretation and write-up 
of results are probably the most important project tasks. This was 
certainly the case here, but this fact was not adequately accounted for in 
the project time line. Hence, while Phase II was contpleted only about two 
months behind schedule, Phase III has consumed ten months instead of a planned one 
nonth. Regrets and apologies are due the sponsor and to the cooperating 
agencies on this account. 



The CRUSK team was called upon for this mission In large part because 
of their past work in pulling together and summai>zing the world literature 
on planning innovation and disseminating and utilizing knowledge. (Havelock, 
et a1., 1969) An important aspect of this work was tl^e derivation of al- 
ternative models of DSU which have been used as interpetlve filters and 
guides to understanding specific DsU events, activities^ and strategies in 
various fields. A large part of the mission tor this project was therefore 
to apply these same analytical tools to four wide-ranging and cc'jplex federal 
agency ''strategies" as perceived by the agencies themselves and by others. The 
results of this theory vs. practice comparison are reported in Chapter Seven. 



Finally as part of this project, we were anxious to generate fairly 
specific and detailed suggestions of how an agency could improve its function- 
ing. Many such suggestions we hoped to derive from the respondents, themselvest 
either via interviews or in the course of the interface conferences. On the 
whole, these suggestions fall short of our hopes, partly because we may have 
under* rated the difficulty of the task and the amount of concentration and 
creative imagination that it requires. In any case, a great deal of time 
has been expended in exploring action alternatives by the principle investi- 
gators, themselves, and these are reported both in the last section of this 
chapter and in Chapter Eight. They are intended not as hard-and-fast recom- 
mendations, but as a cafeteria of possibilities from which each agency might 
choose according to its own current sense of priorities. 

One last point should be made about the write-up phase. After this 
project was well underway, the Social and Rehabilitation Service came forward 
with an additional grant to the senior investigator to develop alternative 
models of a research utilization system for SRS. The grant called for the 
performance of an entirely separate set of tasks leading to a report of a 
different nature, but each project has been helpful in providing insights 
for the other. In particular, the SRS grant allowed us to carry our appli- 
cation of the schema to a point of far greater sophistication and complexity i 
Including an application to the functioning of five well-known federal infor- 
mation services. Because of this cross-fert 1 1 1 zat ion, we have felt Justified 
in Including an important segment of this analysis as a part of this Intro- 
ductory chapter under the heading: "One System Concept: Eight Operational Modes." 



III. SUMMARY 



A, ORGANIZATION OF THE REPORT 

The remainder of this chapter will (1) provide an overview of our 
findings* (2) offer a fresh perspective on the whole question of D&U manage- 
ment derived from the problem-solving linlcage model which evolved in this 
project, and (3) suggest some specific steps that could be talcen by the 
Office of Research and Demonstrations of the Manpower Administration to 
improve its operations in RSD utilization. 

Subsequent chapters are organized as follows: 

Chapter Two presents a description of each of the four D&U units in 
the context of their agencies. Units are described in terms of legislative 
mandate, purpose of research and utilization activities, origin^ hierarchy 
in the larger organization, present operations, other agency D&U efforts. 
Icnowledge base, and audiences. 

Chapter Three serves as an overview to the problem-solving linlcage 
model developed for this project and as an introduction to the more detailed 
analysis of the four D&U units. It also includes a section suggesting various 
ways in which the model needs to be qualified and expanded if its applicability 
to diverse DsU phenomena is to be understood. 

Chapter Four compares and contrasts the four D&U units on each of the 
six O&U functions presented in the previous Chapter. The first section entails 
a short summary of each agency's woric in each area of the model. The second 
section presents a more detailed description of each agency's activities as 
compared with each other and with a theoretical "maximum*' for an effective DsU 
unit. 

Chapter Five contains the analysis of the data obtained in the second 
phase of this study, the pilot questionnaire surveys of MA and SRS. This 
linlcage analysis concentrates on the information network, media preferences 
in the network, information needs In crisis situations, and unmet information 
needs in each agency. 

Chapter Six provides a documentation and evaluation of the two interface 
conferences. Both the SRS and MA conferences are discussed in terms of partici 
pation. design, group process, and evaluation by participants and sta/f. Con- 
ference products developed by the participants are included. 

Chapter Seven analyzes interview and questionnaire responses in terms of 
past theories of DSU and principles of DsU derived from past research. 

Chapter Eight attempts to bring together our observations from the four 
agencies, the two surveys, and the two conferences to summarize and to derive 
implications for action, following the six major categories of analysis. The 
pros and cons of 30 specific alternatives are weighed. 



OVERVIEW OF THE FINDINGS 



It is a little difficull to make a tidy package out of the findings of 
this study for a number of reasons. Very diverse methodologies were employed 
at different stages » and many pathways were explored partly to see if they were 
explorable. Hence» the results are always tentative, always based on small 
unrepresentative samples, case studies, subjective reporting. This is not 
said as an excuse, but only as a comment on the state-of-the-art and a warning 
to interpret what is said in the next few pages cautiously as something more 
than raw speculation but less than hard scientific fact. Here are ten 
general points which stand out and can serve as a kind of summary of what we 
have learned. 

1 . During the 1960's Support of D&U Emerged as a Function of Governmen t 
Distinct from R&D 



Four government agencies which had supported research development 
and demonstration activities In various disciplines over a number of 
years have come to recognize the need for dissemination and utilization 
activities planned, organized^ and managed as a separate function from 
the processes of knowledge creation, research, and development. Roughly 
over the period from 1964 to 1972 separate units representing a variety 
of DSU functions have emerged, first as "dissemination" units^ later as 
"utilization" units. Over these years, they have gradually increased 
in visibility, status, and disposable resources and have rapidly in- 
creased in complexi ty, variety, and sophistication of activities. (Primary 
evidence for this set of propositions is contained in Chapter Two and 
Chapter Four,) 

2. It is Possible to Analyze All Functions and Activities of DSU 
Agencies Tr Terms of a Conf igurat lonal Model of Resourcer-User 
Problem*Sol ving Dialogue 

All participants in research, development, dissemination, and utiliza- 
tion activities can be understood a^^ either "users" or "resourcers" in 
the various transactions that make up their collective enterprise. Each 
of these transactions can be interpreted as a dialogue conducted for 
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the purpose of solving a problem of one party» *'the user/* by matching 
his need or problem situation, with ideas, facts, skills, materials, 
or products held by the other party, the "resourcer." Two acts of 
information transfer are vital to the successful consummation of the 
dialogue, namely the communication of need Information from the user 
to the resourcer and the communication of solution- relevant information 
from the resourcer to the user* Figure 1.2 illustrates the configura- 
tion in its simplest terms. The dialogue can be applied with equal 
meanlngfulness to transacting at the micro level between two individuals 
In a short space of time and to transacting at the macro level between 
communities of user and communities of resource persons. At this macro 
lovel the model was found to fit the functions of four federal RSD 
programs as ''resourcer** systems in relation to broadly defined "user** 
systems of practitioners and policy malcers In given need domains. 



3. The Manner In Which Each of the Four Agencies Manage the 
Problem-Solving Dialogue Is Distinct but Comparable with 
the Others 

An essential first step In any quasi-scientific exploration Is 
definition^ a second step Is description, and a third is oompariaon* 
We feel that It Is a signal achievement of this project that we have 
achieved all three with respect to a very broad and complex set of 
phenomena, namely events or acts in the generation, transformation, 
dissemination, and utilization of research icnowledge. The many pages 
of detailed side-by-stde analyses in Chapter Four are the principle 
testimony to this achievement. Yet we recognize that these comparisons, 
detailed as they may appear to be. are only the beginning of a rigorous 
analytic comparison which might specify all events within a specified 
time period, number of persons Involved or affected, costs of labor, 
materials, etc. The point of the comparisons we have made Is to Illustrate 
that such Is possible even while conforming to a logical sequential con* 
caption of the larger process within which particular molecular events 
are embedded. 

k. It Is Possible to Generate Communication Network Maps Which Include Typ^ s 
o? Information, Media and Flow Among Key Sub-groups of a Larger System 

From two very modest questionnaire surveys we were able to construct 
comparable flow diagrams for the information-systems represented by 
the SRS and MA utilization units and the most salient role groups to 
which they related. These flow diagrams appear as Figure 5*1 and 5.2 
In Chapter Five of the report. From them we derived a number of 
hypotheses and pinpointed a number of gaps and discontinuities which 
yseem worthy of further exploration. The f rultfulness of a network 
mapping approach Is strongly suggested by the pilot data which we have 
been able to analyze here. 



5. Research Information is Rarely Used or Sought in Crisis Situations 



In spite of a general recognition that research information is 
more valid, reliable, and useful than other types of informatid'n, it 
1% rarely mentioned as being used sought after when professionals 
in these networks are confronted with crisis situations in their every- 
day working lives. Host of those surveyed dealt regularly with research 
as a routine part of their work. Despite this fact they tend to rely^ 
heavily only on information easily available within their own immediate 
work environment when they were in a crunch. 

6. Groups in the Network Study Often Mention a Need^for More Evaluative 
and Research Information 

The pilot survey respondents indicated two categories of information 
as needed, beyond the amounts they are now receiving: thesv^ are (l) 
evaf vtative, performance* or statistical data, and (2) research informa- 
tlon, HA respondents mentioned needs in the first category more often 
than they mentioned a need for research. In SRS we found Just the 
reverse. 

7. Attitudes Toward D&U are Dominated by Four Ideologies 

By examining responses to 20 diverse "procedures^' statements 
from all respondents In all four agencies, it was possible to discern 
four distinct clusters of attitudes best characterized by the phrases 
"communicate and collaborate" (Linkage), "help the user where he's 
at" (User-Centering), "plan and organize systematically" (RD6D) , and 
"invest heavily" (Capacity). No one of these ideologies is dominant 
In any one agency and together they represent the main areas of con- 
cern and focal points for Improving DSU process generally. 

8. Linkage Is the Most Important Procedural Element In the D&U 
System and the Most Cited Target for System Improvemen t 

Of the 20 procedural 1 tems^ "col laboratlon and cooperation between 
researchers and users to find and adapt what Is useful" w/is consistently 
rated as most important and most discrepant from the existing situation. 
Linkage issues were also cited most frequently in Interviews as matters 
of concern. There Is widespread acceptance of the view that communication 
should be a two-way process and widespread concurrence that this Is too 
often nut the case. 
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9. Adequate Diagnosis of the Real User Need is the Second Most 



Important Procedural Element in the D&U System 



It Is clear that the communication of needs from users to the 
RSD community Is at least as Important as communication of findings 
to users, and the two activities must be related to each other. 

10. Carefully Organizing the D&U System to Achieve Link.-^.ge and User 
Relevance Is a Third Host Important Procedural Element and Target 
for Improvement 

Most respondents agree that D&U activities are amenable to improve- 
ment through systematic planning and organization, and they endorse the 
effort to devise improved ways to make the "system" function as a 
system. 



C. WHAT IS A D&U SYSTEM? 

ONE "SYSTEM" CONCEPT: EIGHT OPERATIONAL MODES* 



One of the major products of this study is the framework for DSU 
functional analysis described in Chapter Three. The framework emerged from 
our earliest extended interviews with the four D&U unit heads and represents 
an attempt to encompass the full range of D&U functions they each described 
within a single model, a model which makes sense both descriptively and 
logically. Subsequently, we "tested" the framework by describing and coding ^ 
al 1 activities of each agency withfn the categories of the framework (as 
displayed In Chapter Four). Each detailed "case study" so derived was 
rechecked with the staff of each unit In extended feedback review -sessions 
lasting from 4 to 8 hours. Revised drafts were then prepared reflecting 
input from these sessions, so thai the final drafts appearing in Chapter 
Four should reflect a shared perception by the project team and the D&U unit 
representatives. 



*ThIs analysis was prepared in the fall of 1973 by R. Havelock as part of 
the project "Knowledge Utilization Systems for Federal R&D Programs," under 
a grant from the Social and Rehabilitation Service, Department of Health, 
Education, and Welfare. It is Included here becaurie It builds directly 
on the model developed for this project and forms a useful starting point 
for thinking about action Implications. 
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This consensual validation procedure was an important aspect of our 
work; it should be admitted, however, that the basic outline of the model 
emerged not inductively from any Initial tabulation of agency activities, 
but rather from a theory of knowledge utilization evolving in our work over 
an 8 year period. The core concept In this work has been the problem-sol ving 
"link'' or dialogue as illustrated In Figure 1.2* The elaborated model based 
on the 'Mink" serves « its purpose well as a gross cataloguing schema for D&U 
activities as demonstrated in Chapter Four»but many readers will feel that 
it doesn't give them much of a feel for specific operational real i ties, nor 
does it provide too many obvious buttons t<^ push to make their own "systems** 
work better, tf these are defects in the approach to^^n, we believe that 
they are correct ibie through elaboration and extension of the basic "Hnk" 
concept and through application to each of the subf unctions. This work of 
extension and applicatfon wTII have to be carried on largely by the agencies 
themselves because of their separate amphases , priorities, and working styles. 
However, we can make a suggestive start, and will do so first by proposing 
eight alternative subsystems to achieve different DSU objectives. This 
discussion will be a foundation for the last section of this chapter Ir. 
which we will try to spell out some operational steps which might be taken 
now by the Manpower Division of RSD Utilization to improve their function* 
Ing. 



When we talk about a "total" system for societal problem^sol ving via 
research, development and R6D utilization, we are usually talking about at 
least eight types of services, each with a separate special function but all 
sharing a general set of goals regarding knowledge-based societal change 
and also in many Instances sharing structural elements. The eight types of 
services which seem most obvious from our study are as follows: 



1. A Coordinated Mission-Oriented R&D Program 

2. The R&D Product Dissemination Service 

3. The Knowledge-Based Problem-Solving Consultation Service 
k. The Instant Response R&D Retrieval Service 

5. The Rapid Response RsD Report Service 

6. Continuous Flow Dissemination 

7. User-Centered RSD 

and 8. Natural Network Nurture 



Let us consider each of these In turn very briefly. 

1 . A Coordinated Mission-Oriented R&D Program 

There Is some truth to the adage *'bui1d a better mouse trap and the 
world will beat a path to your door.'' Thus, a very high quality product 
which Is directly responsfve to Important and well-recognized societal 
needs will probably find a ready market through national communication channels 
or through the most straightforward and simpleminded dissemination process. 
Hence, in special cases, there is some logic in focusing attention exclusively 
on relevance and qual 1 ty of the product rather than on other aspects of a 
complete linkage cycle such as "need communication,'' "transformation," 
"transmission," "juser helping," and so forth. This is particularly true in 
cases when the innovation which is being developed will have very high re- 
lative advantage (ratio of perceived benefit to perceived cost) and very high 
visibility of results. While none of these conditions generally holds true 
for the types of R&O undertaken in the behavioral and social science areas 
(and for the R$D with which our four agencies are primarily concerned), the 
approach may yet be a useful model for tackling some kjnds of problems* This 
may be the case particularly for social experiments undertaken to answer 
sped fic pol icy questions such as housing subsidies for the poor. Income 
maintenance, work Incentives, and so forth. With these projects, the need 
has been articulated by social scientists and politicians over a number of 
years. The research contracts, themselves, are large and partly for that 
reason alone attract the attention of the press and professional communities 
in the area. Most Importantly they are dictated by a relatively small number 
of . pol icy^ makers at a high level who have a direct interest in the results. 
Under these conditions special efforts or strategies to disseminate findings 
are hardly necessary. 

On the other hand, the number of projects that can fit this mode are 
small. Most problems are not clearly articulated and solution alternatives 
are complex and many, most not amenable to experimental treatment either 
because of the cost or the lack of an appropriate ^est situation. 

[Insert Figure I.3 here] 

Figure 1.3 may suggest some of the dynamics of the mission oriented R&D 
program. Major decision and communication points involve relatively few 
people and clear Impactful messages. In the largest sense, however, this 
"systerrf' still follows the problem-solving cycle from public needs to RSD, 
solution transmission and utilization. The most Intense dialogue and re- 
cycling takes place within the RSD process. Itself, where first prototype 
development work leads to further research on specific "bugs" and testing 
leads to redevelopment cycles^'untl 1 a final test provides unequivocal 
empirical evidence that the Innovation works. 

The need sensing process is a very political one. Past research can 
play an Important supplementary or contributory role but is not essential 
and sometimes ignored or downgraded as not problem- or situation-specific, 
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FIGURE K3 A Coordinated Ml ss lon*Or lented R&D Program 
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not relevant or out-of-date. , The media and sundry dissemination efforts 
may also play a subsidiary synergic role in alerting the public and non- 
participating decision malcers to what lies ahead but this, too» may not be 
seen as essential. "Uti 1 izat ^on'* as a problem may also be downgraded because 
standard pol Itical-legal-admlnlstrati ve action is seen as suf f i cient ^to bring 
the change about. 

Much of what is popularly conceived of as 'important" or 'M nterest Ing" 
research and development on social problems follows this route^ including such 
Items as "Sesame Street," ''Performance Contracting/' and income maintenance, 
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and housing subsidy experiments. In general, such projects are set apart 
from whatever broad-based R&D effort the agency might otherwise have, and 
the types of D&U units^we have been studying play no role in their dissemin- 
ation, implementation, or utilization. 

We beljeve, nevertheless, that an active and aggressive D&U unit could 
play an important educating role with respect to such schemes, partly through 
pointing out the need for more sophisticated, mul t I -faceted and synergic 
need eenaing, resource retrieval, dieseminatioriy and utilization act I v 1 1 ies • 

It is also possible to carry out relatively modest and unpublicized 
projects following the same basic pattern, provided that the intended users are 
a 'relatively small and clearly delineated group, provided they have a very 
clearly articulated and c.i rcumscrlbed need, and provided that one agency of 
government has full authority to support integrated research, development, 
dissemination, and utilization activities. Such an arrangement would* con- 
stitute what we described In the model as orie form of "microsystem building.*' 
Such projects are generally fraught with difficulties, however^ not the 
least of -which Is budgetary. While the giant wel 1 -publ icized projects some- 
times provide a good demonstration model of how a complete cycle of RD&D can be 
actualized, they provide a poor model for smaller projects in terms of cost. 
The development phase. In particular, is very expensive If It is done right; 
it also requires an aggregation of talent which is rarely available to less 
glamorous enterprises. Furthermore such projects, however well conceived, can 
fall victim to larger events In the culture, such as recessions, wars, budget 
cuts, etc., so that the kind of total project planning control originally 
assumed is not in fact the case. Major problems for smaller projects may only ^ 
come clearly into focus at the utilization stage when most of the money is 
spent and time Is running oat; since the projects are initiated at a relatively 
Iqw level without widespread popular support or media coverage to act as 
"syn^rgizers the would-be implementers must rely almost exclusively on the 
user-perceived intrinsic value of the innovation alone. There is little or 
no political 9 legale or administrative power to back up the change and no 
social pressure either.* 

2. The R&D Product Dissemlncitlon Service 

It is neither necessary nor usually desirable for one unit of government 
or one R&D organization to have responsibility for all phases, of the societal 
problem-solving loop. In fact, three of the four agencies ^we have studied 
were origi nal ly organized to take responsibility only for transformatioi; and 
transmission of completed R&D products As these units developed a mCTre 
sophisticated view of their function, they expanded into utilization and user 
helping and in some cases' into need sensing and Influencing the R&D process 
as well. Nevertheless, a strong case can be made for a unit which operates 
entirely in the dissemination mode, provided (a) that there are a reasonable 
quantity of R&D products worth disseminating, and (b) that the dissemination activi- 
ties are well planned, meaningfully targetted and operate in a manner which 



*ThIs appears to have been the kind of situation which confronted the University 
of Michigan Manpower Laboratory in attempting to develop and install Improved 
organizational management procedures in employment services. 



**The NIMH unit is the exception. 



is responsive to genuine user needs « Of these the first qual i f icat iorf is 
.peroaps the most important, for while an ineffective program to disseminate 
good .products is frustrating and disheartening, an effective program to 
dtssemifnate had products can be disastrous. Nevertheless^ a DsUojnit i 
placed by higher authorities in the position of selling a product, and 
th1$ Is the case,we believe that (hey can operate a meaningful,- safe, 
effect Ive^program within the limitations set. Figure 1.^ partly i llustrates 
the situation. , 

FIGURE ].k Ideal Model of an RSD Product Dissemination Service 
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Again reading this figure clockwise from the ''Target Population/* we 
aasune that many constructive steps have gone forward in the past (dotted 
areas) leading up to the point at which the Dissemination Service takes over. 
Generally speaking, for many problem areas these are not wild assumptions; 
wherever a broad» loosely defined, and reasonably well financed research 
program has been in existence for a number of years (which is i.ertain1y the 
case for mental health and education), we can reasonably expect that various 
activities have taken place correspondK.^ to steps **l/' ''2/' and "3/' 
Usually they will not have occurred In a well organized, sequential, and 
integrated fashion, but thdre will be enough sclence*based relevant infor- 
Mtion available to make a dissemination program worthwhile. 

Nevertheless, when the Oissenilnation Service takes over^ it myst begin 
by recapitulating the first stages of the problem-solving cycU for three 
reasons: first, because the current need situation may be quite different 
(but usually not totally different) from the need situation when R&D activity 
was first undertaken; second, because it cannot take for granted that all 
.available products are equally meritorious; and third, because it needs in- 
formation on needs and on the innovitions to design the appropriate strategies 
of transformation, transmission, and user helping. Hence, activity steps "V' ^nd 
•'5" have to ba Included as Integral parts of the Dissemination Service system. 

Step in this kind of service may consist mostly of a market research^ 
operation In which the demand-potential of various existing R&D products Is ^ 
assessed by panels of representative users. The primary purpose of such 
assessments is not to Influence new RSO but to guide selection and relevance* 
screening from the existing resource universe (Stage #5) ^nd to Indicate what 
sorts of transformations will be required for which audiences (Stage #6). 

We have left I>> abeyance any cons I deration of how the Dissemination 
Service Initially acquires or receives candidate products for dissemination.. 
Usually these will be Items derived from the'larger agency's R(D program, but 
this Is not strictly necessary, provided the Items have clear relevance to 
designated target populations. It may also be that for very large R(D pro*- 
grams a separate se9rch activity will have to be conducted to bring in a 
sufficient quantity and verify of products. 

Sta^e '*5/* '*i^&D product screening and reassessment** Is extremely 
Important for ^ever«l reasons: first, the economics of effective dissemination 
are such that only a few products can receive a full Stage 6 through 10 
treatment. Hence» only the highest benefit^ highest quality, and highest 
relevance ltM|S can be chosen, assuming a limited dissemination budget. Second, 
the widespread dissemination of Ineffective products gives the Dissemination 
Service (and the R&D program as a whole) a bad name, turning off potential 
users from future innovations. Thirdly, even quality products which are 
directed to the wrong audience^ cai^have similar negative consequences. . 



Fourthly, there may be some products which could do major harm to users or ( 
to the society, either via their primary intended effects or through second*' 
order consequences. Finally, a screening operation is necessary to provide a 
comparative basis for evaluating a range of products, since In nearly all cases 
the original "evaluations'* and ''field tests" performed as part of the R&D 
process will have been done on a product*by*product basis and in most cases 
will not have taken Into account "dissemlnabi 1 1 ty" criteria. 




Host of the above considerations entered the picture when the NCEC 
initiated a special dissemination program for the products of Educational 
Laboratories and Centers. Among the four agencies studied, this effort 
represents the nearest attempt to organize a complete dissemination service. 

Once products have been Identified, .screened and selected, certai n types 
of transformations are almost always in order before effective communication or 
transfer to users can take place. This usually includes the preparation of 
brochurM sumMrizIng the product's objectives, components, evaluative data and 
•ndorseiiient% and displaying this information clearly and in a way that attracts po- 
tential users without misleading them. A dissemination ''package'* may include differ- 
ent types of material for decision makers with different roles or at different 
levels in target user organizations, it may also include film strips, slide- 
tape sequences, sample materials, or other multi-media segments. While 
the Oissemination Service can hope that much of this material will have been 
prepared by the developers long before they get the product, they can never be 
assured of this and should therefore be prepared to undertake such transforma- 
tion activities. 

Following transformation, a fully effective dissemination program for 
any product requires a carefully planned, timed, and coordinated approach 
involving Stages 7t 8, 9t and 10 of Figure 1.4. The mass media efforts 
(Stage 7) may consist primarily of announcements of the product's availability 
in the professional journals or magazines with highest readership among the 
most salient practitioner group. Preferably these are in the form of news 
releases or special feature stories, but advertisements should not be ruled 
out. Hailing of brochures Is also desirable if suitably target-representative 
mailing lists are available. These media efforts have several purposes, the 
primary one being to create general awareness of the product, its purposes, and Its 
promises. Secondly, the media effort should attract the first level of inquiry 
and hence the initial examination of the product by media-oriented innovators. 
While these innovators are usually not typical or representative of the target 
population as a whole, they do provide a point of entry and an initial reaction 
which signals later problems or opportunities to the dissemination staff* A 
third function of the media campaign is to alert opinion leaders and higher 
level decision makers In the target population prior to or in support of special 
dissemination events aimed In their direction (Stage 8 in Figure K't). 

Specialized targetted events may consist of specially convened conferences 
to which opinion leaders and higher level decision makers are invited, preferably 
to attend in teams representing their organizations or localities. These sessions 
would also include researchers, developers, and disseminators, and there should 
be opportuniti es for compl ete display of the products with take-home samples 
%#here possible^ as we'll as^bpportunltles for information exchanges among users 
and between users and resource persons. 
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Either in conjunction with or subsequent to these special events the 
dissemination staff should present demonstration activities or events appro- 
priate to the product (Stage 9 of Figure 1.4). Although the nature of these will 
vary substantially with the type of product, such demonstrations should display 
the product In successful operation In a situation which viewers can consider 
typical or directly similar to their own. This will often but not necessarily mean 
that the demonstration sites will be localized. Target population representatives 
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should again be invited in teams, including those practitioners who would 
be directly involved in implementation. 

Demonstrations should be followed up quickly with some sort of direct 
consultation services (Stage 10) to those interested in making trial adoptions. 
Such consultations have several functions vital to successful utilization: 
e.g., (a) they provide a continued source of informational input on the pro- 
duct; (b) they provide an opportunity for assessment of the true situation of 
the u<er and the relevance of the product to him; such consultants should even be 
in the position of diaauading certain users from adopting certain products if 
their inspection of the user's situation so suggests ; (c) they provide an 
important source of personal motivational support for taking a chance on some* 
thing new; and (d) they provide help on problems ot adaptation and implementa- 
tion which many users will not initially be sensitive to at the time of the 
demonstration. 

One final set of f unct ions, **D&U monitoring}* (Stage 11) is essential to 
a dissemination service because it completes the problem-solving cycle and 
provides feedback to each of the other functions. All activities of a dissem- 
ination service should be governed by accurate knowledge of their effects. 
This means that data and documentation should be collected on user reactions 
to each stage as it occurs so that mid-course corrections can be made. In addition, 
every complete dissemination sequence for separate products should be evaluated as 
a totality, such reports being used to redesign the system to improve future 
product dissemination. 

We have no doubt that a dissemination branch can be organized for any 
federal R&D program to operate successfully in the fashion described above and 
outlined in Figure 1. 4, and that where a. number of suitable products do exist, 
they will be thus disseminated and will provide predictable benefits to designated 
users, or at least to large enough numbers of them to justify costs of the dis- 
semination effort. 

No one of our four agencies has attempted to organize Itself Into such 
a service on a continuing basis. There have been a few pilot experiments 
where something like this sequence was followed for single products (e.g., Glaser, 
E.M., 1967, for the VRA, predecessor to SRS; Glaser, E.M., 1968, for SRS; 
Glaser, E.H. and Ross, H.L., 1971 for NIMH; Fairweather, G.W. , Sanders , D.H., 
and Tornatzky, L.G., 1973, for NIMH). The NCEC has also tried to follow a 
similar process for RsD products of the Educational Labs and Centers, and for 
selected programs In reading; the NCEC*s efforts differed from those previously 
cited in that they involved a number of products and In that the overall process 
was planned and managed centrally by NCEC w'th contracts let for subcomponents 
to different public and private institutions on a competitive basis. While It 
is true that all these programs were not uniformly successful (the appropriate- 
ness of the product. Itself, as a candidate for dissemination and Its relative 
advantage being major stumbling blocks) they provide enough evidence to support 
the main thrust of our argument here. 

One puzzle which remans to be solved is how to organize a dissemination 
service for more than one product. There appear to be three principle alter- 
natives. The most rudimentary could be called the "one product-one program*' 
approach. This is based on the assumption that different Ri^O products deserve 
completely different types of dissemination programs In which dissemination 
skills may not be transferable, channels are different, audiences are different, 
O id helping services are different to the point where perhaps an entirely new 
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project staff must be recruited. Such assumptions of uniqueness might well 
have been implicit in the pilot dissemination experiments cited above; even 
though In one case a contractor was rehired for a second and a third Job» there 
was no necessary overlap In staff or procedure, and contractors made no 
representations to the effect that they were about to take on such projects 
on an assembly line basis. 

It should be added that where the DSU unit insists on the original 
RSD contractors talcing full responsibility for dissemination activities, 
they are wittingly or unwittingly instituting a one project-one program 
pol Icy. 

Yet there would appear to be considerable redundancy and wastage in . * ^ 
following this ad hoc project^to-project aporoach too far. For example, an examine 
atlon of documented programs such as Glaser's and Fal rweather 's shows remarkable 
similarities and suggests that an approach which we might call the ''assembly line" 
Is also feasible and perhaps more efficient than ''one product*one program." 

The "assembly line" acknowledges the Importance of focused effort on one 

product at a time but It asserts the possibility that certain persons might 

specialize In transformation, media, conferences, demonstrations and consultation, 

regardless of their particular subject matter expertise, and that when one pro* 

Ject Is at a certain stage of dlssemlnatlon,another can be Initiated. None of 

the four agencies studied has been able to develop such an assembly line approach 

as nearly as we can assess for a number of reasons: (a) funding for dissemination 

has not been large enough or consistent enough to allow It, (b) there has not been 

a clear consensus Internally within the federal D&U unit Itself, that an asseaibly^^ 

line was desirable, feasible, or central to agency goals, and (c) there has not 

perceived to havB been sufficient flow of quality products Into the unit from R6D 
sources. 

A third approach to organization of a dissemination program would be 
a multiple product Integrated program In which several products would be pro- 
ceeding simultaneously through the various stages from transformation to 
utilization. Such a process would open the possibility of directing more than 
one product at an audience at one time and allowing some degree of user choice 
among alternative products depending on the specific user^s need situation. The In- 
put to the dissemination service could then be governed by consumer demand and coulc 
operate somewhat like the marketing division of a commercial firm with h 
broad product line. There would presumably be various economies of scale 
In this type of operation, and there would also be synergic effects from 
developing "brand" recognition (provided the screening remains rigorous). 
In general. It would appear that this kind of operation Is only possible If 
the DSU unit Is wel l*f Inanced and backed up by a very large RsD program (such 
as the totality of NIHH projects or those of the National Institute of Education). 

3. The Knowledges-Based Problem-Solving Consultation Service 

Yet a third mode of operation for actualizing the RSD problem-solving 
cycle Is illustrated In Figure 1.5* The prime focus of this approach Is 
suggested by the solid lines In the figure, and In particular, the recycling 
dialogue between consultants and particular users. In contrast to the 
Dissemination Service approach, the Consultation Service does not engage in 
unsolicited communication concerning a particular product or line of products. 
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FIGURE K5 



A Knowledge-Based Problem-Solving Consultation Service 
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Rather, It defines a fairly broad need area within which it can provide various 
consulting services of which R&D information Is only one aspect. The controlling 
element Is the user's need as defined and perhaps redefined by the user in 
dialogue with the consultant. If this need suggests the relevance of a 
particular product, all well and good. but. If not. a range of Information and 
solution Ideas may be applicable, some coming from various bits of basic and 
applied research, some coming from other users with similar problems, some 
coming from thi judgments of experts who have studied the problem, and some 
coming from within the user's own environment and from the user, himself. 
The consultant helps the user search and explore these potential resources, 
and may also provide help In the process of problem-solving as such on which 
he should be expert. 

As part of the exploration process, knowledge-based consultants wlH have 
at their Immediate disposal two types of organized knowledge resource mechanisms, 
the RSD Information service and the expert bank. Both mechanisms could be In- 
side or outside the service. Itself, but they must be Immediately accessible 
and the consultants should be thoroughly schooled In their use and motivated 
to use them Wherever appropriate. 

This approach stands or falls on the techniques and the skills of the 
consultants themselves. They must be much more than conduits for R6D Infor- 
mation: In addition they must fulfill each of the tasks Indicated by Stages 
), 3, 5> and 6; they must have a repertoire of helping skills Including the 
building of trusting task-oriented relationships, personal and organizational 
diagnosis, providing psychological as well as Informational support, encouraging 
risk taking and broadening perspectives on alternatives for action, adaptation, 
and Implementation. Among other things, they must be able to model and visibly 
demonstrate satisfactory Information-based problem-solving strategies for users* 
They must In some sense also be both good listeners and recorders of user 
responses to their Inputs. 

The consultants also need to have an awareness of other Impacts on the 
user. Information and pressure from other sources Including peers and superiors, 
others In the community and so forth (suggested by dotted arrows aimed at user 
In Figure I.S). Inputs from consultants must be timed so that wherever possible 
they act synerglstlcal ly with such other Inputs rather than counter to them. 

The consultant service approach arises out of a realization that Information 
transmission, by Itself, Is not enough to bring about beneficial changes which 
could truly be r^ted as "utilization." Both the NCEC and the SRS 0$U units 
moved strongly In this direction in the late i960's, setting up experimental 
pilot projects In which a consultation service with a problem-solving consul- 
tant was the central fixture. They also attempted to provide training 
roughly along the lines suggested above. Both experiences have betfn evaluated 
and further evaluations are continuing. Evidence to date suggests that while 
ttiere are many problems, the role Is both tenable and useful, ft Is less 
certain that benefits accrued Justify the costs Involved.* 
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*A current NIE contract to the Institute for Communication Research at 
Stanford University Is seeking to establish appropriate quantitative measures 
for such an assessment. 
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Three major questions concerning the establishment of a consultation 
service can be raised however: first, however valuable It may be, is it a 
proper part of an agency charged with dissemination for the R$D products of 
a given agency; second, how far can and should the service go In involving 
itself In user problems, i«e., where does responsibility end; and third, 
can we afford it? We will consider each question briefly. 

a» Iq a problern-^aolving consultation service relevant to the 
federal DiV function? and/or vice versa? 

The IOiowledge*Based Consultation Center Concept brings together 
two Ideas of ''helping*' that have traditionally been viewed as separate, 
namely knowledge transfer and process consultation. The former has 
J traditionally been a topic of study In library science, journalism, and 
schools of communication; the latter has been the primary concern of 
psychologists and human relations-oriented professionals In related 
disciplines^ Hence, the descriptions of consultation process appearing 
In the bulk of the literature (and there is a bulk) on the planning of 
change, social Intervention, changing and humanizing organizations, etc. 
pays scant attention to the potential utility of ^'outside*' knowledge 
sources such as would be represented In a federal RSD program. Training 
for the pilot consultant programs of SRS and NCEC have reflected this 
division. The SRS training was managed by persons heavily oriented 
toward the human relations process side while the NCEC trainers focused 
on Information transfer as a communication skill and on the ability to use 
Information services, principally ERIC, with maximum efficiency. With 
the professional experts and trainers thus divided^ It remains difficult 
to make a fair test of the marriage of the two concepts In the role as 
conceived and advocated here. 

b. How far should a consultant go in providing help? 

From the Informationist and the human relatlontst standpoint, 
the know ledge* based consul tant, may Intrude too much on the Ufe space 
of the user, not only by suggesting answers to problems but also by helping 
to define tliem and helping to Implement solutions. Where does expert 
Intervention properly leave off and self-help begin? There is no easy 
way out of this dilemma but there are a few guiding principles that 
might keep the consultant out of deep water. ^ One Is 

voluntariami never do for a client what he doesn't want you to do, and 
rely on his asking you as much as on your suggesting to him. Another 
Is colldborationx as much as possible the consultant should get the 
user Involved In the search and solution building process, leading by 
example but always looking for ways to let the user pick up the task . 
for himself. A corollary of this principle Is for the consultant to 
always leave his own processes open for Inspection so the user knows 
what he Is doing and why. A third related principle might be never 
do anything tb>ice all the way* Every act of helping should also be^ 
an act of training; after setting the example of how to work on the first 
problem, the consultant should be able to play only an advisory role 
on the next one, and stay completely out of the third and so forth. 
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c. Rao can we afford it? 



In service domains as broad as '^manpower/* '^mental health/' 
**educat Ion/* and ^'social and rehabilitation services/' the number 
of needy potential users who could make profitable use of knowledge- 
based consultation services Is staggering beyond Imagining. The 
painstaking, personalized operation described here would appear, . 
on the f^ca of It, to be grossly unresponsive to the level of demami.* v 
We cafTDegin to answer this question in at least three ways. FlF^t, 
we can be highly selective in the types of users we try to reach, 
choosing (a) those who are most 'Important'* on some criterion such as 
power or level in the system, (b) those most visibly in need, or (c) 
those In the best position to set an example for others through their 
visibility, central ity, and opinion leadership. Regarding the last 
mentioned possibility, it is Interesting to note that "Involvement of 
Informal leaders of opinion" was the least popular among twenty pro-* 
posed alternative D&U procedures for staff members In each of the 
four agencies studied and for the two pilot "network" surveys. 

A second an/wer is to provide the service, not as a service 
but as a demonstration*and-tralnl ng device to show and train users 
to help themselves in a similar fashion. 

A 

A third approach is simply to set limits on the services provided, 
e.g., to exclude follow-up, to take need statements at face value, to ^ 
provide Information without Interpretation, or to adopt a pure human relatloilH 
stance and skip the Information part entirely. These are all hard choices and* 
there simply Is not enough Information at hand on the relative i|ffect Iveness of 
different elements in the overall approach to make wise decisions. 

4. The Instant Response RSD Retrieval Service 

A fourth possible mode of operation for a DsU unit would be to provide 
information on demand to any particular user for any particular and Immediate 
Information need he may express within a broad topic area at any time. The 
concept is not really ^s radical as It sounds from that statement , however. 
In fact. It Is reasonably close to the old notion of a library, a place 
where you could go to find Information on any topic that was of interest to 
you, where you could be guided by a simple catalog card, and sometimes a 
librarian, to a particular shelf, where you could pick off a print package 
(book or Journal) which contained the Information sought, sit down and read 
it right then and there. It has been a fine concept and It works pretty 
well for some people some of the time. It works particularly well for the 
scholar-experts who tie together a field of knowledge and push It forward 
with new theories and hypotheses based on an accumulation of past findings. 
For this reason, if for no other, any broad-based RSD program requires a library 
component, some sort of archiving of Its printed products so that they are available 

*But probably no less responsive than recommending private psycho- therapy for 
every needy psycho-neurotic In the land. 
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request to \/arious users. Indeed, each of the agencies studied has wore 
or less satisfactory means of doing this either by themselves or by feeding 
their material to a more centralized library system. 

Yet the library concept has held much more promise than it has been 
able to deliver. It has tended to service the needs of only a very special 
type of user and even that use has been greatly affected by the proximity 
of the library to the particular user. Therefore, one important potential 
role for a D6U unit is to develop new mechanisms to speed response, simplify 
and ratiof^allze access, localize service, and widen the range of response so as 
to satisfy a broader range of users with a broader range of user needs. 
New technology iuch as computers, remote terminals, microforming, photo- 
copying, etc., accompanied by an explosion of knowledge in print form have 
added to the temptation to move in this direction. 

Of the four agencies in our study only one, the NCEC, has done a 
^substantial amount of exploration In this arena and the resuUs are not too 
clear* ERIC was Initiated as a "one-stop" Information service to supply 
the Information needs of a wide range of profess ionals^in education and to 
provide Information cheaply and quickly from a comprehensive file. The basic 
archival features of this system are now established and functioning well. 
Furthermore, the volume of output to users has Increased substantially 
from a slow start to the point where It can have a significant Impact on 
the vast population of educational users. 

Nevertheless, the EKIC system does not go very far In reaching out to 
users or In tailoring responses to them, and its efficiencies can only be 
appreciated by regular users who liave easy access and a good grasp of Its 
thesaurus* It Is possible to go much further in information servicing and 
there are a few Instances where this has been done, for example. In the 
"hotline" of the Congressional Research Service* Figure suggests a. 
framework for such a service within the context of the larger DSU process which 
we have been considering. 

[insert Figure 1.6 here] 

In contrast to the consul tat ion service, there is no real Inyolvement 
In the user's situation, either In diagnosis or implementation* A very great 
variety of need situations are assumed and the formulation of "need" Into 
"information need" Is the responsibility of the user himself. This Is not 
to say that the Initial statement Is taken at face value; some sort of 
dialogue must take place between the user and some representative of the 
service both to code the request so that It can be routed properly and to 
verify and clarify what Is being asked. This "question negotiation" Stage 
(13 In the diagram) should be handled by a trained "operator"* who formats 
the request so that It can be processed efficiently by the service. Again 
In contrast to the consultation service, the operator does not develop a 
sustained personal relationship with the user and preferably should not have 
to return for a renegotiation on the same request. This stage might be handled 
In a 5*10 minute phone call. 


*The Far West Laboratory for Educational Research and Development has developed 
a training module explicitly for this purpose as part of their "Educational 
Information Consultant" (EIC) program. The module Is fairly well suited for 
9^xh training regardless of the field of knowledge. 
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A third contrast with consultation is the requirement of a very 
systematic division of labor. Because the service aims at high speed 
accurate response for a large volume of users, it needs ^o have an established 
routine for request processing involving several steps which .can be executed 
in rapid-fire succession. It should be emphasized, of course, that Figure 
1.6 suggests only one of many hypothetical combinations; the elements are 
spelled out here only to give the reader a more concrete idea of the kind 
of process that is involved. The rationale for each stage Is discussed 
below. 

a. Ueev Soliciting and Training 

It is important to think of an information hotline service as an 
R&D innovation which, itself, must be advertised and marketed to the 
* Intended user^ populat ion. Hence, in some respects the installation of 
the service follows the mo^el of the second operational mode illustrated 
in Figure 1.2. In other words, there has to be (1) awareness building and 
(2) demonstration prior to any anticipated (3) user initiatives. The 
demonstration event must give both a visible example of an information 
request being handled fast and well to a user's satisfaction and it 
must give each attending person a chance to try out the process there 
and then both to see for himself and to develop the minimum Initiating 
and responding prerequisites for later use when he is in his normal work 
environment. 

Demonstration events can also act as training situations for hot* 
1 ine operators. 

b. Hotline Operator a 

As previously discussed, the service must have available at all times 
(probably at telephones) persons whose Job is to receive and format Incoming 
requests and to conduct a brief interview with (the requester to delineate 
the question as much as possible. These operators would be the sole channel 
for request inputs. Operators might also have the task of heading off 
inappropriate, excessive, or outlandish requests, and lirrfittng the expectations 
of the requester. 

o. Routere % 

Although it is possible that operators in a small low-volume 
service would Kave full knowledge of where to transmit requests, the 
routing function Is clearly distinguishable. The router, mu^t have a 
. firm grasp of the capabilities of each subsystem^ and must make a pre-, 
liminary determination of how a request cdn be handled most quickly 
and completely. Routers ar^ also in a good position to monitor and 
tabulate requests to assess what types of users are askJng what types,' 
of questions and to determine what new types of resources are therefore 
cal led for. 
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d. Situation Simulators 

Because the router should never^ have to spend morf" than a few 
seconds on any one request so as to keep the flow moving , he should 
have a back up person or team to whom he can send puzzling^ difficult, 
or very non* routine requests (assuming these have not been blocked 
by the operator). The task of this group is to find out or to provide 
a fairly accurate guess of (a) what the user "really" wants and/or (b) 
what a response ought to consist of. We call these "situation-simulators" 
because we imagine their mission tobe to empathize* w I th the user, to get 
inside his head as much as possible. This may require e second brief 
interchange to gain additional diagnostic' information from some users. 

Typical 1y» once the simulation analysis has been done, the information 
requirements can be clarified and the router is able to channel the 
request to the indicated processing locations. ^. ' 

» 

Remote Infomation System Access 

T. - ' 

The hotline service should have at Idast one staff member who under- 
stands and has easy access to al 1 relevant and publicly available RSD 
Information banks. Accessible material should be from government ^nd 
private sector sources^ from reports » books » and journals » completed 
and on-gohng projects, etc. This person should have on-line remote 
terminal acxess to as many of these s>5tems as possi.ble. Such coverage 
Is important In fulfilling the requirement of comprehensiveness which 
wMI be vital in establishing the credibility of the service as a "one- 
stop" Information system for some users. 

Remote Human Access . 

An effective hotline service should not rely on print sources 
alone. In many cases the best r^ipld summary source for a response will 
be a person. Therefore » the service should have a human resource file 
with two types of listings. One would be "experts »" I.e., people who 
have done R&D in a particular area and/or have a reputation of knowTedge- 
ablllty. These persons may be used In at least .three ways» e.g., (1) to 
gl>^e references to appropriate print sources, (2) to provide "of f-the-top- 
of-the-h^ad" answers to the request, (3) to be referred as a name back 
to the requester:^ 

A second important pool of human resources are those persons who 
can be identified as knowledgeable or experienced practitioners who are 
known to have been faced with the same sort of situa^tion or setting as the 
user, himself, preferably In the same lodellty ("on-call user colleague pool 
In Figure 1«6K One possible source for building such a file would be 
f o rmer reques te rs . 
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Assuming a large volume of requests from a large number of requesters, 
many requests will be redundant or largely so. Hence, it Is Important 
to accumulate all orepared responses filed by subject matter for future 
reference. This "hot file" should always be searched first by the router 
because it provides the most efficient and by far the speediest means 
of responding. 

h. Message Composition 

Accessed information from any of the above sources should not be 
dumped in raw form on the requester unless it Is asked for in this Wv3y 
(which may be the case for RSD requesters, for example). Hence, some 
minimum amount of screening, ordering. Interpretation and summary are 
required prior to output. The amount and type of such composition might 
be tailored to the type of user making the request and the user's 
indicated purpose. In any 'event, a "hotline" service cannot do a great 
deal in this area If it wants to retain its "hotness." 

i. Output ^ 

Output can be a more or less routine matter, but there may, need 
to be some flexibility here, too. For example, while most output would 
presumably be mailed in one packet to the requester, an urgent 
request may require a telephone summary response in addition to or 
Instead of a mailing. The output department should also be avaMat^le 
for receiving user questions on material received, and they may be In 
the best position to solicit user reactions (Stage 5 In the figure). 



While the mechanics of a "hotline" service may seem obvious enough 
on paper, the. desi rabi 1 1 ty of this operational mode Is difficult to 
assess against others because it has never been given a fair and com- 
plete test. Like tire consultation service, there appear to be enormous * 
cost problems, part lct#^rly in start up. 'These Include Initial promo- 
tion-demonstration efforts, recruitment and training of specialized 
staff, assembly of hunjan access lists, etc. However, In contrast to 
a consultation service there are very significant economies of scale 
once the system Is working. I.e., there Is the possibility of handling 
n/)' a large number of requests, and, assuming redundancy of requests and 

an accumulating hot file, speed and accuracy of response ought to go 
up dramatically as ^he user population ^ets very large while the cost per re- 
quest goes down. On the other hand, this may not happen until the hot file 
reaqhes massive proportions unless other restrictions are placed on 
users such, as limiting subject matter , of request and restricting users 
to a certain category of practitioners with a peculiar* set of problems. 
Alternatively there could be an Increasing scale of charges depending on 
the amount of Information requested or provlded^or depending on the 
number of processing steps asked for^ 
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There \s no question that an Instant response mechanism Is desirable, 
sis of responses In our two pilot surveys suggests that In many 
s situations the speed of response In Information terrtis Is crucial. 
The problem^'epmes^^l-n desjgning a system which can produce high quality In- 
formation r*I^vaht to ^he-jji(e#d^at hand economically. 
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5. The Rapid Response RsD Report Service / 

While the Instant response mode discussed above ^cao^ro vide Information 
service of a very specific nature tailored to specific users, It cannot pro- 
vide such Information lij^a very sophisticated and Integrated package unless such 
already happens to ex4lLt somewhere in the accessible resource universe. But It 
should be poss1b1e.<o design a service which not only reviews existing sources 
but also composes a comprehensive state*of*the art analysis for the user 
In highly rr^ak^ble form. To our knowledge only one existing organization, 
the Congressional Research Service, has been set up to provide such a service 
on a routine basis* Figure K7 proposes some of the components which we 
feel are necessary parts of such a system. We call It "rapid response" to 
suggest that while quality tailored reporting cannot be performed Instantly, 
It can be performed within a cycle which gives thle requester Information he 
can use within days or weeks of the time he expresses ytfie n^ ^ for It. 

[Insert Figure I. 7 here] 



Like modes 3 ai^d 4, this system starts with an Initiative by the user 
who In this case could be a person jor a group. In contrast to the Instant 
response mode, the user here must be selective In proposing a need; the "need' 
cannot be a trivial request nor something of a crisis nature for. which a 
response Is required on the spot. It must, therefore, be something that has 
gnawad at the user for some time with some Intensity such that he feels It 
%#orthwhl1e for someone to spend time and effort on a solution. 

a/^o^ In contnsist to the consultant mode, the need must be clearly 
an information need for which a search of existing RsD sources Is highly 
relevant. 



The core of this system Is someone we call the "wrlter*expert ." This 
person must be, on the 'one hand, generally knowledgeable about the domain of 
RSD to which the request Is directed and, or the other hand, able to 
write In a clear. Integrated way for non*academtc readers. Because this 
combination of skills Is fairly rare and highly sought, the Rapid Response 
Service may have Its greatest problems In recruitment and adequate compensa* 
tlon for the pool of persons It will have to keep on*cal1 for response 
missions. 



Figure 1.7 proposes four distinct subsystems necessary to. the task: 
(a) the wri ter*expert (or more precisely a pool of such persons); (b) Infor* 
ma tlon banks which can be searched efficiently for comprehensive retrieval 
of existing RSD literature; (c) the rapid response unit (RRU) , Itself, which 
organizes and monitors necessary Interchanges; and (d) a policy review panel 
which verifies the Importance of the request and authorizes major responsive 
actions. 

One possible pattern of action leading to a "rapid response report" Is 
suggested Hy the numerical sequence In Figure 1.7. The best way to explain 
this operational mode might be to review the proposed sequence. 
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(1) The Information Request Statement. The first step in a particular 
cycle is the preparation by a user (and preferably a group of users working 
together) of an information request statement to be submitted to the RRU, 
probably in a pre-established format. This assumes, of course, that the 
service as a whole has been previously *'sold'* to the user and that he has 
received the minimum level of training and encouragement to want to try 

it out. For this mode we would expect a minimum of user soliciting and 
training, however, because, on the one hand, the system does not require 
and cannot handle a high volume of users or requests, and, on the other hand, 
it builds in a high degree of user*resource interaction so that the user is 
not on his own in stating the need or interpreting the results. 

(2) Request Clarification and Redefinition Dialogue. Specialists in the 
RRU discuss the request with the user (probably by telephone) in order to 
clarify what Is being asked for In terms that can be readily understood by 
both the review panel and the writer*expert. This specialist will also 
verify the level of need, and perhaps the degree of consensi^s in the user 
organization that this is an important need. This specialist will operate 
at a different level than the "hotline operators'* of mode #4 in that his 
dialogue with the user will be longer and deeper and in that he will be 
more involved In analysis and routing of the request. It will probably 

be necessary*^ for RRU specialists to have some expertise in the general 
subject are£ of the request. 

(3) Rapid Rep^ort File Search. The first processing act of the RRU should 
be to search its own backlog of responses to determine If the same request 

has been made by another user in the recent past. For early requests, of 
course, there will be no such backlog, but over a long period of operation 
we wou!d expect many requests to be redundant, in these cases the RRU 
becomes. In effect, ^n instant response system unless substantial updating 
or adaptation is required. 

(4) Preliminary Document Search. The RRU should next make a quick search 
of the information bank to which they have readiest access to determii'e the 
scope of literature available on the topic and to locate wha^ver Item^i 

if any, fit the request very closely. If there appears to be a "hit,*' this fact 
may be communicated directly to the user to see If he is satisifed. This 
search should almost certainly be computerized*on-l Ine to meet "rapid 
response" requirements. 

(5) Preliminary Dialogue with Writer-Expert. With preliminary search data 
In hand, the RRU now sets out to locate a writer-expert (WE). The document 
search should give important clues on promising candidates for this role 
unless a WE pool Is already established. The purpose of the dialogue is 
two- fold: first to get an overview of what an adequate response might 
consist of, how much work would be Involved, and a summary of what the WE 
already knows on the topic; and second, to determine the competence and 
willingness of the WE candidate to take on the report task If It should 

be authorized. Again to Insure rapid response, this stage would have to 
be conducted via telephone. * 

(6) ^.Action Request. The RRU assembles the Information gleaned from 
Stages 1 through 5 In the form of a request for action by a review panel. 
The request should spell out some alternatives with estftnates of time frame, 
dollar cost, feasibility of a.high quality product, and probable benefits- 



The Policy Review Panel. A very Important role can be played in this system 
by a review panel composed not of experts but of reasonably high level 
practitioners, administrators, or policy makers, probably within the federal 
agency. Itself. The panel would serve at least two functions: one to Increase 
the circle of user involvement including both awareness of the problem and 
consideration of the results, and second to judge the relative importance of 
the request and to authorize appropriate action based on that Judgnent and on 
the panel's knowledge of the budget and capacity of the RRU. 

The panel should be able to meet at least once a week as a group to 
review and act on requests, or al ternat 1 vely, they should be available on a 
day's notice for such a meeting. 

(7) Panel Dialogue with User. It will usually be desirable for the pani^l to 
have face-to-face discussion with the requester to get a better appreciation 
of .the need and its importance as well as to make visible to the user the 
importance of making adequate utilization of the findings. 

(8d and 8b) Action Decision Options. The review panel should be prepared 
to take at least four alternative action steps, depending on the importance 
and generality of the request* Certain requests may be Judged of such 
importance, original Ity, and long term interest that they call for new initia- 
tives in research and development with appropriate funding (8a). This option, 
of course, assumes that the panel has sufficient authority or influence to 
make such an action meaningful. In the event of this action the 'Vairtd 
response" feature is abrogated and the process essentially reverts to the 
first operational mode discussed earlier. 

Other options (8b) range from (i) curtailment of further action and 
allowing the information already collected to stand as an adequate response 
to the user; to (ii) authorizing an expanded or redirected search of Infor* 
matlon sources ^nd/or experts, limited to one or two days labor In total, 
leading to a terminal feedback to the user or possibly to a recycling 
of action by the panel; to (III) authorization for the RRU to negotiate a 
contract with the WE for the "Rapid Report." 

(9) The Riipld Report Contract. The rapid response service will not work 
unless the RRU can draw up an agreement with the writer-expert that (a) 
rewards him adequately for his services (at 1973 prices this probably means 
a minimum of $500 and a range up to $2,000 depending on the assignment and 
the seniority of the WE), (b) sets reasonable limits on what he is to do, 
(c) guarantees that the work will be done quickly (probably with a one-or- 
two week deadline), and (d) specifies the minimum search activities that will 
be engaged In. In no case should the product be merely a think-plece without 
any search and review, nor should It be only a rehash of work the WE has 
already done. I.e., It should be an original state-of-the-art summary, and 
analysis with Implications for action and utilization by the user should be 
spelled out as clearly as possible. 

(tOa and 10b) Final Need Statement Communicated to WE. Once the report 
contract has been negotiated^ the first act of the WE should be to Interview 
the user to gain a clear and fVill understanding of the circumstances related 
to the needt in effect to simulate the user's need situation. In this respect, 
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the WE may start out not too differently from the consultant (Mode Hi) except 
that he Is aiming at a written product which win be primarily of his own 
making. An RRU specialist may also have to mediate this exchange by helping 
the user reformulate his need ()0a) and helping In the process of transferring 
the new formulation from the mind of the user to the mind of the WE (10b and 
10c). 

(11) The Report Outline. Based on Inputs from the^ontract, from his user Inter- 
view, and from the preliminary RRU search data, the WE prepares an outline of the 
problem to guldf^ further search and integration of his report. 

(12a and 12b) WE Search Activities. The WE should be expected to make a 
complete re-lnqulry of the RSD Fnformation system possibly utilizing a fresh 
set of descriptors based on his outline. How much. he can do will depend 
partly on the adequacy of such systems, themselves, of course. Thus, he 
should not be expected to search many diverse sources nor to use material 
which Is costly* and time consuming to acquire and digest. 

The WE should also be expected to indulge in some consultation with 
knowledgeable colleagues and others who have expertise In the topic ^area 
(12b). Probably, there should be allowance in the contract for the WE to 
pay for such additional consultation up to perhaps one or two hundred dollars. 

(13)«nd (14) Assembly and Production of the Report. At least 1/2 of the 
total effort of the WE should be spent thinking through the problem and 
spelling out alternative solutions based on RSD whenever possible. This we 
see as essentially a creative act for which the highest order of skill, 
sophistication, and sensitivity are required. The euoeeea of tite Byatm 
etands or falls on -the quality of the integration and the writing. 
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dSa and 15b) Communication of the F^apld Report. The original requesting 
user should be the primary recipient of the report and should receive the 
report In writing and orally (15a), allowing for dialogDe about understanding, 
Interpretation, and possible applications. The RRU may also want to participate 
In or monitor this feedback event. 

The report should also be entered Into the active file of the RRU (15b) 
for possible future use either In the rapid response service or In dissemina- 
tion activities (Hode #2) designed to reach users in circumstances similar 
to those of the requester. Because of the checks included In the review 
process and the participation of the policy panel, there will be every reason 
to believe that the report will have widespread utility beyond the particular 
needs and Interests of the original requester. 

(16) Absorption. Understanding and recognizing the full implications of the 
report Is a process that will likely take many days or months after the 
report Is submitted. In this internal activity the user may wish for and 
solicit help from the WE, the RRU^or members of the policy review panel, but 
in any of these exchanges he Is on his own to initiate and. If necessary, to 
pay for the help he desires. Conceivably, for example, the user and the WE 
may be stimulated to submit a Joint proposal for a research project or a 
demonstration experiment of some kind to test out and carry forward Ideas 
contained In the Rapid Report. Hopefully the review panel would be In a 
position to facilitate or underwrite such actions. 
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(17) Utilization. Final disposition and impact of the report is again in 
the hands of the user. Hopefully, if Stages (1) through (16) have been 
managed successfully, he will have material that Is very important and relevant 
and he wi H have It within a few weeks of the time he originally requested It. 
Potential applications will have been discussed with the WE and earlier with 
the policy review panel and the RRU. But beyond this, this service does 

not go. Conceivably, of course, by combining Mode #3. and Mode #5 comprehensive 
utilization services could be provided which include such functions as help 
in designing and modelling specific changes, and support for risk-taking. 
Such intensive follow-on services are not outlined in Figure 1.7. 

(18) Feedback on Impact. This operational mode, like each of the others, 
requires a continuing built-in cybernetic mechanism. The success and failure 
of each step In the sequence should be evaluated and the system should be 
reorganized accordingly. Most important Is the feedback on the results of 
the total process in terms of user satisfaction and specific evidence of 
successful uti I Izatlon. 

Coat and Benefit of a Rapid Reeponee Service. While It may seem that the costs 
of a system such as that described above are very high, they may be offset 
by a number of considerations. First of all, the reports have the potential 
of being genuine contributions to knauledge and may be worthy of publication 
and of special dissemination to a wide community of practitioners, policy 
makers, and researchers. As mini-research projects, in themselves, the 
reports may also be comparatively cheap. Finally, with the review process 
included, there can be strict limits on the number of requests serviced and 
the quality of the request. 

Comparing the four DSU agencies In our study, we find that each In fact 
does produce highly targetted, Interpretive state-of-the-art summaries from 
time to time often in response to urgent requests from high level persons 
in their own agency. Yet these requests are responded to more or less in 
an ad hoc manner. There Is no routine, no delivery system, no real quality 
control mechanism, and no clear budgeting accountability for most of these 
activities. Thus, It would appear that a carefully designed rapid response 
service would be an especially appropriate mechanism to Initiate, at least 
on an experimental basis as a service to government policy makers. If to no 
other users. Thus, the decision makers in government bureaus could at least 
be on an equal footing with their neighbors In the Congress. Indeed our 
pilot survey question on Information "crises" indicated that the Congress 
as well as high government officials represented the major stimuli and 
audiences for "crash" Information. 



It should also be noted that one of the four OSU units does have a 
somewhat routlnlzed program of studies comparable In some ways to the Rapid 
Response Service, this being the "Targetted Communications Program" of 
NCEC. There are Important differences, however. For example, initiative 
lies heavily with the writer-expert both for establishing and defining the 
need and for disseminating the results. Project costs are accordingly 10 
to too times greater per product while relevance to particular needs of 
particular users Is still not assured. The Rapid response feature Is also 
not built Into this program, most projects being planned for completion 
In a matter of several months. 
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Of thft eight modes proposed In this analysis^ it seems to this, writer 
that this one has been the least tried and Is perhaps the most ripe for 
experimental try*out by those who wish to bring significant Improvements 
to the D(U process. 



a. PeiKodicala 

Most traditional channels for the communication of research findings 
Involve continuous print dissemination via periodicals. Most federal 
RSD programs, directly or Indirectly, Intentionally or unintentional ly^ 
provide a major source of Input to these media. Actually the Journals 
play at least four distinct fuffctlons In the total D^U process. First, 
and perhaps most iiiq>ortant1y , they are a means of archiving research 
materia] In a general or specific discipline. Second, they are often 
(but not always) used as a means of screening material for scientific 
quality or, in the case of the popular Journals, quality and general 
Interest. Thirdly, they are used as a measure of scholarship and 
academic performance especially as part of university promotion policy. 
Only^ fourthly and by no means most Importantly are they vehicles for 
direct dieeeminations and least of all are they vehicles of communication 
from the RSD community to practitioners or policy makers. 

Recognizing these facts the four O&U units we have studied have 
introduced various popularized media to provide a more or less con* 
tinuous flow across the gap from research to practice, or from research 
to policy. Some popular magazines such as Psychology Today and Society 
attempt to reach an even broader audience. We believe that the errects 
of these bridging media may be quite important, particularly In building 
general aixawteee of available R&D and In educating some users 
to be more sophisticated about RSD processes and what they can and 
cannot offer. On the other hand, continuing dissemination usually does 
not do much for the particular user, either In homing In on his real 
problems or providing the Iclnd of support necessary for utilization. 

Thus, while continuous flow can no doubt be Improved tremendously 
by adding new newsletters In flashy formats with better material more 
adequately condensed and analyzed from the potential user^s perspective. 
It Is hard to see it playing other than a supplementary role to other 
operational modes* 

b. Selective Diaaemination of Information (SDI) 

Several Information services In recent years have made limited 
experiments with what Is usually called '^selective dissemination,*' 
meaning the regular dissemination of newly publlshefd material tc various 
cooperating users based on a profile of particular user Interests and 
Information needs. This targetting approach may go a long way In making 
some users more attentive and appreciative of what they get sent, but 
we still see this essentially as a variant of continuous flow dlssemlna*' 
tton. There Is individualization but only In a general sense and not 
targetted to a particular user problem at a ^particular time. 



Continuous Flow Dissemination 
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While SDI does not, in itself, represent a total answer to either 
targetting information or a DSU system, it might well be extremely 
functional as an additional element in modes /j^3, 4, and 5 in each of 
which, over time, a fairly sophisticated profile of user needs is 
accumulated and^ in the case of #4 and 5| where an important backlog of 
packaged information is accumulated continuously. Thus, past users [ 
with an established need can get newly created or updated packages via 
SDI whenever a new user enters the scene with a similar request. 

One interesting variant on the SDI approach Is the distribution of 
literature or summaries in card or punched hole formats and with 
cataloguing-indexing notations so that each user can accumulate his 
own easy*reference- f i 1e in a box or loose-leaf binder. With this 
arrangement the SDI potentially comes much closer to being a localized 
and personalized instant retrieval system or ''hot file." The success 
of such a system would depend in part on the degree to which appropriate 
user habits of filing and storing such tidbits could be built up and 
maintained. It would also depend on the narrowness of the user's 
interest and the amount of information available. Either a wide interest 
range or a large volume of material would make a user's file too large 
and too expensive to be practical, either for the user or for the 
servicing agency. 

User-Centered RSD 

a. Ad Hoc Ueer Fee ear ch Servioee 

It can be argued that user needs are often so unique and so much 
tied to a unique set of conditions that all past R&D Is mostly irrelevant. 
If this Is the case and If the users happen to be wealthy, very influential, 
or designated by someone as very Important, they may calt for a complete 
cycle of research and development tailored to themselves. Typically 
market research Is of this type as Is much organizational research and 
some federal policy research. Generally such ad hoc research fits the 
pattern of operational mode #1. Certainly such research Is unlikely 
to encounter relevance problems when It comes to the iitlllzatlon stage, 
but there can be serious problems with timing (It takes time to do good 
research, even more time to do good development) and coat. It would 
seem preferable for these reasons to plan such ad hoc research so that 
it does have some generalization potential and to conduct It in con- 
Junction with and supplementary to a rapid response system as Is suggested 
in Stage 8a of Figure 1.7* 

b. User Collaborative RSD 

Another alternative which Is essentially an elaboration on mode #3 
assumes that past research may be somewhat relevant but that users will 
never grasp the full Implications and move toward utilization unless they, 
themselves, get Into the act, planning and conducting their own research, 
posing or lielping to pose the questions asked, and analyzing the data 
right along with the researcher. Here, too, there Is a lot of logic on 
the training and utilization side of things, but the costs of going through 
such a process for every client are staggering. The outcomes are also some* 
what uncertain since collaborative RSD requires an unusual combination of re 
search, development, and consultation skills on the part of the outsiders. 
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^'Organizational Development** sometimes describes a special type of 
collaborative R&D Involving Social scientists with survey research, 
small group training, probUm-solving and consultation skills in various 
combinations working with the user organization as a whole. The type of 
involvement In problem-solving that can be achieved with this approach 
far exceeds the consultation of mode #3 or the information-only approaches 
of modes #4 and 5* 

OD is especially attractive and relevant to D&U in promising to make 
organizations more open to new influences from within ^nd from without. 
'Mnside'* influences might include the attitudes of their own members, and 
an honest appraisal of their own needs, objectives, and their own potential 
as people. "Outside" Influences might Include new Images of potentiality, 
concern for customers or for the environment, learnings from what other 
organizations like them are doing and perhaps RSD generated elsewhere. On 
the other hand, these promises of OD are not consistently realized with present 
techniques, and they assume a level of commitment by user which a D&U unit Is 
seldom in a position to command. Thus in SRS when an OD unit was 
established to assist internal management. It had no direct relation- 
ship with the research utilization unit; In the Manpower Administration 
the utilization laboratory (at University of Michigan) which focused 
on OD techniques. had great difficulties gaining access to user organiza- 
tions, and when they did, the extent of Openness to outside R&D which 
resulted was minimal. 

It Is still somewhat unclear how OD techniques can relate to a 
larger plan for comprehensive D&U services. The promise remains, and 
the desirability of careful experimentation Is evident. 

8. Natural Network Nurture 

The D&U unit never comes on the scene before a flow system of some kind 
has been established. There Is always some sort of network In being already, 
a network of researchers forming Into loosely Integrated "Invisible colleges 
around topics of mutual Interest and networks of users at various levels, often 
fornallzed as professional Oi'ganlzatlons of one kind or another. Such "natural" 
networks represent a kind of D&U system and they also represent an opportunity 
for a newly arrived loN-proflle Icv^ budget fesfaeral D&U unit. T^e D&U unit can 
move In a variety of ways to improve tie functioning of this natural flow 
system and push It gently in the direction of utilization. It can do so by 
subsidizing special Journals, supporting special utilization conferences » and 
providing small grants to promising young Investigators to steer them Into 
greater Involvement with the D&U process. These actions are not necessarily 
trivial If they are managed and orchestrated with full knowledge of the weak- 
nesses of the "natural" network. Indeed the most serious weakness of existing 
networks Is likely to be the formal and Informal clustering of practitioners 
and researchers Into separate camps divided by mutual disdain, suspicion, and 
ignorance. Federal agency staff members can themselves play a ve/y positive 
role as "honest brokers" between the two camps and can also lend support to 
others to do tht^ same. 
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We have stressed In the preceding discussions and in each of the diagrams 
the fact that any operational mode exists wfthin a much larger information flow 
environment which Includes thousands of messages, many generated in the dim 
pasc, and countless actors in the practice world and the RSD community. Al- 
most all of these messages and actors are completely outside the control or 
cognizance of any single DsU agency, yet they profoundly affect what it can 
do and how well it can function in any mode. Hence, there is some justifica- 
tion in developing strategies which exploit this larger social-informational 
environment to the fullest. 

Combinatiom 



There Is no reason, in theory, why one 0$U unit could not operate 
in all modes simultaneously, assuming unlimited staff and resources. 
There is nothing inherent In any one approach which makes It incompatible 
with any other. The greatest divergence may comA between modes #1, 2 and 6 
on the one hand and #3i 5 and 7 on the other, since the latter are cTearly 
user Intltiated or user-centered modes while the former are more or less 
product or research centered. All modes share a number of assumptions, 
©•g-» (I) that research and development provide the most valid and 
reliable clues to Improved practice^ (2) that therefore effective trans- 
fer of RSD to practitioners should be made, (3) that this transfer can 
be Improved and speeded through systematically planned Interventions, 
\S) that user needs» broadly def lned,should guide and control what RsD 
products are transferred to users, and (5) that user attitudes and effects 
on users should be used to redirect the R,D,D and U efforts. 

Manifeatation of the Operational Modes in the Agencies Studied 

When we turn now to look at these eight alternatives In comparison 
to actual DSU unit policy and practice, we find an Interesting pattern, 
namely that none follows any of these modes with any consistency while 
all dabble in each mode to some degree; NCEC with the most resources has 
been able tc dabble the most. 

The reasons for this lack of pursuit are more than purely budgetary, 
however* One additional factor has been the lack of clear and well 
developed mod.els of how a system ought to function; another may have 
been confusion and changing signals from policy makers regarding the 
proper role of a DsU unit (suggested by the constantly changing names 
for the units and continually oscillating budget allotments) « It is not 
fair to criticize what has been done by the unit staffs under these 
circumstances; Indeed, to the contrary one should stand In awe that so 
much has been done In so many areas with such modest resources, witness 
the few blank cells of the side-by-slde functional comparisons ln*2 
Chapter k. 
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HoQ to Build on Whap We Have 



Looking fo'rward rather than backward, we should think how to 
organize and plan a step-by-step progression toward any one of these 
ideal operational modes. The first step, It would seem, would Se 
to decide as 'a matter of policy which mode deserves the highest 
priority. Among factprs entering such a determination should be 
(a) potential payoff, (b) capacity to sustain a consistent policy 
of support for the activity until a fair test has been made, (c) 
the existence of an appropriate backlog of knowledge (particularly 

/hecessary for mode #4) or some high quality RSD products (particularly 
necessary for mode #2),' (d) clear precedents for the activities (not 
so true for modes #4 and 5) t and (e), anticipated start-up and maintenance 
costs. " ( 

/ 

IV. . IHPLICATIONS FOR CHANGING THE MANPOWER DSU SYSTEM 

4? 1 
A. TACKLING THE MEASUREMENT PROBLEM 

This project has laid the basis for a systematic and detailed analysis 
of D&U functions. One outcome of such an ianalysis ought to be a monitoring 
and management procedure for all DSU activities which allows for a coherent 
accounting and reporting of achievements and a pinpointing of problems and 
deficits on a regular basis. Two steps need to be undertaken to develop 
such a procedure: first, the tentative quantification of major elements of 
the descriptive model, and second, the development of appropriate criteria 
and measures of D&U effeate. Let us consider each of these steps. 

1 . Quantification of Model Elements 

Chapter Four illustrates in some detail the range of activities that 
riiight^e undertaken by a "maximal'* D&U unit'. One can get from the side- 
by-side comparison of the four agencies some notion of the relative 
emphasis and investment in each of these activities^ but thgs far no 
numerical accounting has been rendered. If the category schema is 
deemed satisfactory as a reasonable first approximation, the next step 
should be to begin making estimates for each category of (I) staff 
man-hours invested, (2) contract funds expended, (3) number of products 
involved, (4) number of persons affected, etc. At the beginning of this 
process there should be less concern for precision than for exploring 
the posslbMltles of quantification. This quantitative overview when 
completed should give a number of clues as to where operations are strong 
pr weak, productive or unproductive, costly or economical, and thus 
should be a useful planning tool. However, the quantitative overview 
for the first two or three years should be treated very tentatively 
and revised continuously as more sophisticated ways of measuring and 
counting functional emphases emerge. The segments of the model, itse\,f, 
will have to be weighted according to the set of priorities laid down 
foW the agency, e.g.. If primary responsibility for ''needs assessment* 
resides elsewhere In the agency, then presumably it should receive a 
far lower priority rating than, let us say, transformations. 
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2 . r^. Developing Satisfactory Measu-^es of DsO Impact 



An analytical quantitative monitoring process will Tieve^ be very 
convincing until It can be tied to measures of output or impact which 
have some widely recognized meaning and value. To attack this problem 
head-on, the Division should contract for one or more projects designed 
specifically to ^»eek out and spell out such measures. It is certain 
that outcomes cannot be measured slmpl istical ly by counting the number of 
publications sent out or the number of persons attending a conference 
or the number "satisfied" with what they have heard or read. Studies 
to develop measures of research utilization consequences should start 
out by composing taxonomies which cover the full^ range of possible 
* Impacts, Immediate, short term, medium term, long term, positive and" 
negative. They should estimate which amohg this array of consequences 
is fully definable, observable, recordable, measurable, or quantifiable. 
The purpose of the taxonomy would be four-fold. First, it would act 
as a squrcd for developing various cost-benefit formulae^ from whi ch 
the Dlc^lslon could select the one with which It feels most comfortable*, 
secondly; It would provide a wider context within which the adequacy of any 
particular fofmuia can be Judg^* For example, it is likely to be argued 
^ that a given formula overweights certain kinds of impacts^ e.g., number 
« ^ or requests or number of copies sold, merely because these particular 
••impacts" are quantifiable. The taxonomy tests this argument by show- 
ing us what the formula leaves out. It also serves a third /unction 
in providing another basis for choosing and clarifying Division goals;^ 
and a fourth function In pointing to Impacts for which the development, 
of a measurement capability Is most important, so that cost benefit 
formulae can be Improved. 

The measurement of utilization impact will be the single most vexing 
question for DsU system managers in the middle 1970* s. As D&U functions 
have become clearer In the late 1960*s and early 1970*s, we have begun 
to see the promise of a fully integrated system of ^DSU as a separate 
and equal segment of the societal problem-*sol ving process alongside 
••Research and Development ,•• but to achieve this status, DSU units will 
havje^to persuade the policy makers with more than lo^ ^ and more than 
elaborate Images of what the Ideal system might look like. They will have to 
demonstrate convincingly that existing sample efforts have Impress^Ive 
benefits which far outweigh their costs. 

B. CHOOSING PRIORITIES 

In beginning the implications with the measurement problem^we have, in 
effect, asserted a first priority: that the Division should first know Itself 
.and be able to describe Itself In specific terms. It is the first priority 
In part because priorities for self Improvement cannot be meaningfully 
established without a knowledge of what exists now. Beyond the measurement, 
itself, however, there are a number of other steps that can be taken to 
develop priorities. 

^Division goals can be defined in terms of either desired impacts (as derived 
from a taxonomy of consequences) or from an analysis of functional actlvitieb 
(as suggested In Chapter Four) or optimally a combination of the two. 
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The process of choosTng priorities should, as much as possible, 
be (a) collective, (b) open, (c) tentative, (d) specific, and (e) 
documented. It should be collective in that all persons who have a 
professional stake in the Division should participate in the formula- 
tion, and should be allowed to develop, as much as possible, a sense 
of identity with arrd ownership of what emerges. It should also be a 
process which is open to the ideas of relevant outsiders, experts and 
prime users, and to the ideas and the assent of relevant decision and 
policy makers inside the MA. It should be cast in a clearly tentative 
form because of the tentative status of our knowledge of DSU and the 
resulting necessity to change priorities as we get a clearer idea of 
what is needed and what is desirable* Finally, it is important to 
make a epeoific documentary record of priorities to serve as a con- 
tinuing guide to day-to-day action and as a means of displaying the 
mission of the Division to relevant others. 

2. What " 

Five sections of this report provide a basis for five different 
types of priority setting, and it would seem desirable to enter such 
a process for each type as suggested below. 

a« Preferred Operational Mode(s) 

At the broadest level the Division needs to decide which 
among the eight operational modes described in the previous 
section of this chapter best describes (a) the way they operate 
now, and (b) the way they would like to be operating in the 
future. This is of the highest importance, first, because the 
operational mode largely determines the set of specific activities 
' and subsystems which a DsU unit is required to have and, second, 
because no D&U unit in the foreseeable future will have the 
resources to perform satisfactorily in all eight wpdes simul- 
taneous ly. 

b. Define Gaps and Targets for Improvement Among Division 
Activities 

Within the context of the preferred operational mode, the 
Division staff might then examine the portrait of current acti- 
vities, function-by-function, as summarized In the second column 
of the comparative analysis in Chapter Four. Preferably this 
will be done after that analysis is further specified and quantified 
along the lines proposed in Section iV-A-1 above. This inspection 
should point to certain elements as underemphasized and certain 
others as overemphasized, further suggesting gaps and targets for 
improvement either in terms of upgrading, expanding, or phasing 
oCit. 

For example, a great deal of energy invested in generating 
periodicals would be fine if the continuous flow mode were top 
priority, but if knowledge-based problem-solving was top priority, 
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followed by Instant response and rapid report, this would suggest 
the desirability of deemphasizing or phasing out these periodicals. 

c« Define Gaps and Targets for Improvement in the Research 
Information Flow Network 

In various sections of this report starting with Figure 1.1 
and continuing through Figure 3*1^ and Figure 5*1> we describe 
both ideal and actual configurations of linkage which comprise the 
Division's social environment. The data related In Figure 5«.l as 
well as Table 7*11 point to specific points i/here the linkage Is 
weak or problematic. Each of these suggests; an area for future 
emphasis » but the Division should decide which interfaces are mb$t 
vital and most relevant to their overall mission. 

d. Choose Aspects of the Process of D&U Where Improvement Is 
Most Desired 

, Chapter Seven of this report, which de&ls most directly with 
the overall process of D&U rather than with the specific linkages 
or the functional sequence of activities within it, provides several 
clues to areas of needed improvement'. For example. Figure 7*6 
displays ideal-actual comparisons on 20 procedural aspects for 
the network as a whole. Presumably the Items with the largest 
discrepancies are a starting point for change, but Division staff 
need to review these Items in terms of their overall priorities, 
select those on which there is the highest consensus, and then 
proceed with the planning of specific changes to reduce the 
discrepancy and enhance the performance of the network. The 
H-E-L-P S-C-O-R-E-S analysis provides an additional or alter- 
native basis for working on **process" Issues. Judging by our 
interview responses on these ten dimensions^ increased "structuring" 
of the Division's activities might be In order. The entire priority 
settt/ig process. If adopted, would certainly be a significant move- 
men^'ln this direction. 

e. Prioritize the "Improvement Options" of Chapter Eight 

S The last chapter contains a discussion of the pros and cons 
of 30 possible improvement options for a O&U unit. The options 
are ordered sequentially In terms of the problem-solving linkage* 
model used to compare the activities of the four DSU agencies. 
Division staff might read carefully through this list, rating 
or rank ordering each Item on a scale of probable Impact, cost,' 
feasibility with present resources, etc. Separate ratings could 
then be pooled and discussed, Internally and externally, prior 
to a final determination of priorities. Preferably this priori- 
tizing of specific task areas would be preceded by the other types 
of priority choosing activities suggested In Items "a" through 
"d," but this need not be the case. 
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IHPROViNG LINKAGE WITH POLICY MAKERS AND LINE AGENCIES 



As a matter of principle, we would prefer not to point to specific 
recommendations without giving the Division a number of options to choose 
from. C. ti>^ points, however, we would prefer to be more explicit because 
in one we sense that there is a serious problem crying out for solution, 
and in th^ other ther^ Is an opportunity which should be seized upon. 

The problem area it> •'he relationship of the Division zo the Federal, 
Regional, and State Offices which constitute the 'Mine" agencies In the 
Manpower system. There seems to be some consensus that a gap exists here 
which Is both informational and interpersonal^ and It deserves special 
attention. Print, oersonal, and group exchanges with all levels of this 
"line" system should be increased, 'oint research utilization conferences 
especially for their benefit should e organized, and collaborative projects 
involving their leadership sh^ld be encouraged* 

The opportunity lies In the area of providing improved services upwa rd 
in the Manpower Administration. The Div4sion has generally enjoyed good 
relet ions 1^1 th higher layers of management in iHA and with the Office of 
Planning Evaluation and Research (OPER) . Hence» there should be some open- 
ness to providing these Important audiences with some innovative DSU services 
on a trial-experimental basis. The two which we would propose from our 
study of a range of possibilities would be the Daily Newsletter (Improvement 
Option #18) and some scaled-down version of the "Rapid Response Report Service 
proposed as "Operational Mode #5" earlier In this chapter. Such a service 
has never been operational Ized outside of the Congressional Research Service 
and se^ms to provide a unique and novel method for transforming research for 
use based on user needs. The chief drawbacks of the system appears to be 
the cost of servicing maay users and the availability of writer experts. 
These drawbacks are present to a much lesser degree if the designated users 
are restricted Initially to policy makers in problem areas where an R&D 
program has been operating for some years. 

the survival and advancement of the D&U function in our society depends 
to a very large extent on the good will, understanding, and support of 
government leaders, tt is, therefore, of great importance to provide thtse 
leaders with first hand successful experiences with research utilization 
by way of a well planned and competently executed direct service activity. 

If through such demonstrations we can prove the worth of O&U as a 
distinct enterprise, we will be given the opportunity of following through 
on the many promising but costly system improvement opportunities which are 
detailed in this report and elsewhere. 



-46- 



CHAPTER II 
OSU UNITS: ORGANIZATIONAL PROFILES 



I. DiVISION OF RSD UT I LI ZATI ON/HANPOVER ADMINISTRATION 



A. LEGISLATIVE MANDATE 

The legislative authorization for the Manpower Administration's 
research activity came from title 1 of the Manpower Development and Training 
Act (mDTA) of 1962p which was later amended to include authorisation for the 
experimental and demonstration (E&D) function at the federal level. Additional 
funds were added to the Manpower research program under Title I of the Economic 
Opportunity Act (EOA) of 196^1 in connection with work experience and training 
programs^ as well as the Work Incentive (WIN) Program under Title IV of the 
Social Security Act. With the additional sources of funding, the total research 
budget has increased to about $23 million. « 



B. PURPOSE OF RESEARCH AND UTILIZATION ACTIVITIES 

The purpose of Manpower Administration Research and Development (R&D)* 
has been described as the development of "information and methods for dealing 
with the problems which interfere with full, productive, and satisfying employ- 
ment for all American workers^ so that Manpower programs will both enhance the 
workers welfare and strengthen the nation's economy." ** The goal of utiliza- 
tion efforts has been closely related to the program-oriented mission of 
Manpower RSD: to develop a manpower system for the disadvantaged and other 
target groups which Is "...continually absorbing and using new Ideas, new 
techniques, new forms of organization, new ways of delivering services." 



C. ORIGIN 

In 1966, Dr. Curtis C. Aller, the Associate Manpower Administrator for 
Policy, Evaluation, and Reses^rch, issued orders that R&D utilization activities 
must occur both within the EsD program of the Office of Special Manpower Programs 
(OSMP) and the Office of Manpower Research (OMR). A small Clearinghouse and 
Utilization Group was already established in OMR and a Division of Utilization 
was developed in OSMP. 



Efforts In this area before the utilization requirement included a contract 
for ^'Operation Retrieval" to synthesize earlier EsD produces, incorporation of 
special arrangements for utilization Into some contracts, and a clearinghouse 
designed to assemble Information on automation and technical change. Seeds of 
the activities of the present Division of R&D Utilization were developing with 
the operation of both utilization units in l^te }S66. Dr. Edward Glaser, 
Director of the Human Interaction Research Institute In Los Angeles, planned 
and conducted a multi-agency seminar which was sponsored by the Manpower Adminis- 
tration In 1966 to share agencies' utilization strategies and develop a "doctrine" 
of uttUzatlon for the HanpcMer Administration. 



* "Development", as used here, includes both experimental and demonstration 
projects. 

** Experimental, Demonstration, and Research Programs , 1970 (author unknown). 
*** Memo written by Judah Drob, March, 1969- 
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The two utilization units were responsible for dissemination and util* 
Izatlon (O&U) activities within the ESD and research arms of the Manpower 
Administration. OMR was responsible for the more academic-oriented research, 
whereas OSHP administered the experimental and demonstration programs. In 
April of 1970, the staffs of the two offices, OMR and OSMP, were merged to 
form the Office of Research and Development (ORD) for the purpose of providing 
A more ''Integrated'' research and development program. At this time, the 
staffs of the two utilization units were also Joined to form the present 
Division of RSD Utilization. 



D. HIERARCHY IN IHE MANPOWER ADMINISTRATION 

The Manpower Administration Is only one of the major administrative and 
program areas of the Department of Labor. It contains staff with various 
functional orientations. The Assistant Secretary, the Manpower 

Administrator, arid the Deputy Manpower Administrator's Offices are primarily 
concerned with policy and planning decisions. The Office of the Deputy 
Manpower Administrator also serves as the point of control for all contacts 
and communication channeled to the regional offices and the State Employment 
Security Agencies, with clearance procedures required by the Office In order 
to Insure that all directives and instructions sent are congruent with 
present department policies. 

The program people at the federal level, e.g.. United States Employment 
Service (USES), as well as the regional offices, serve as Intermediaries to 
the state and local programs funded by the Manpower Administration (such as 
State Employment Services, Neighborhood Youth Corps, WIN program, etc). The 
decentralization of some authority and funds to the regional and state levels 
has shifted the functions of program people at the federal level In that they 
now provide staff support and establish general guidelines and policies for 
the state and local operating offices. 

The Office of Planning, Evaluation, and Research (OPER) serves both 
policy makers and administrators,, as well as program people In the Manpower 
Administration. OPER consists of the Office of Research and Development (ORD) 
and the Office of Planning and Evaluation (OPE). OPE staff provide assistance 
for planning and evaluation of the Manpower programs; one division provides 
policy advice and research Information to the Assistant Secretary and other 
decision makers, while another division performs or contracts to have evalua- 
tion studies done of various components of the Manpower programs. This latter 
function links them to the program people, such as tHose In USES, OEDP, the 
WIN program, etc. ORD staff provide assistance to the research, experimen- 
tation, and demonstration efforts of the Manpower Administration; It was 
estimated that 95% of the research done In the Manpower Administration Is 
administered by this Office. Within ORD, responslbM It les for the research, 
experimentation, demonstration, and utilization functions are allocated 
separately among five divisions, one of which Is the Division of RSD Utilization 
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E* PRESENT OPERATIONS OF THE DSU UNIT 



1. Staff 

As of November of 1971 1 the time of IntervlewinQi the Division 
of R&D Utilization consisted of the Division Chief » six other professionals, 
and three clerical staff. The backgrounds of the Division's staff members 
are varied, although most have been working in the Department of Labor for 
numerous years. Rather than coming in as DSU specialists, they generally 
have knowledge of various substantive areas in Manpower programs. 

2. Funding Base 

The Division does not have control of its own budget; Instead, 
the R&D budget is pooled at the ORD level where an annual RsD work plan is 
developed among the divisions and the Director and Associate Director of ORD 
(input also comes from program people at this time). The Division presently 
has $1.75 million in current contracts, out of a total of $23 mill Ion for 
a1 1 of ORD. 

3. Functions 

Division staff members are active in R&D contract and grant work 
both funded through the Division and outside, and in dissemination and 
utilization activities. All of the professional staff work with other 
divisions and contractors through the "buddy system", In which they a'^e 
generally assigned to various projects on the basis of their substantWe 
areas. Through this system, they collaborate with project officers In other 
ORD divisions during the life of the projects In order to plan utilization 
strategies and define user groups for the research products. The largest 
percentage of staff time Is spent in this activity; estimates ranged from 
10 to 66t, with an average of about S0%* Staff members also serve as project 
officers for those contracts administered directly by the Division In addition 
to other Individual assignments such as various tasks with written output (the 
annual R&D projects book), and liaison or "linkage" roles. 

The secretarial staff members of the Division play an Important role 
In dissemination activities through maintaining a library of all completed 
project reports, mailing copies of reports on request, and maintaining and 
enlarging a mailing key which serves as a basis for sending out various Division 
products. They also have become Involved in project record keeping and work 
on the annual projects book, which Involves a good deal of contact with other 
divisions. 

Manpower Administration staff outside of the Division were asked 
to describe their perceptions of the Dtvlslon^s functions frequently mentioned 
the following: distribution of research results to users within and outside 
of the MA; suimarlzat Ion and other types of transformations of research reports; 



development of utilization strategies at various points In the process of 
research production, dissemination, and utilization. Staff members who have 
worked with the Division through the **buddy system** more frequently mentioned 
the Division's responsibility for development of utilization strategies; 
whereas those not directly involved In the **buddy system** more frequently 
recognized the Division as a disseminator. 



F. OTHER MANPOWER DSU EFFORTS 

The Division of RSD Utilization is not the only place within the Manpower 
Administration charged with disseminating knowledge and getting It used, 
although It has been Identified as the focal point of such activities. Some 
staff In other divisions of ORD have actively participated In utilization 
activities of the Division. 

The Division of Evaluation In OPE, which performs or contracts to have 
evaluation studies done on Manpower programs, has set up a system to Implement 
findings of the evaluation studies. This Division meets with program people 
at various points In the project and sends reports to the Division of Policy 
Studies and Analysis In OPE; the latter Division Is charged with providing 
Information and advice to the policy makers of MA. The Division of Policy 
Studies and Analysis sunmarlzes results and spells out policy Implications of 
the evaluation studies for the Assistant Secretary and program people. 

Some program people In USES and OEDP perceive themselves as having respon* 
siblllty for utilizing the products of R&D as well as of evaluation. With the 
assistance of ORD, they have used their series of letters to the field to 
relay some research Information. They also distribute some R&D materials, such 
as handbooks. 

The Manpower Administration Office of Information also serves a general 
dissemination function. Its focus Is that of providing published Information 
of a more general nature rather than relaying only technical R&D Information, 
which Is more the function of the Division of R&D Utilization. 

The Experimental Manpower Laboratories sponsored by the Manpower Admlnls* 
tratlon were also mentioned as sources of D&U activity. The Experimental 
Manpower Laboratory of Corrections at the Draper Correctional Center In 
Montgomery, Alabama, has been particularly active In dissemination efforts. 



G. THE KNOWLEDGE BASE 

The Olvlslon of R&D Utilization has a clear focus on that R&D Information 
produced by the Manpower Administration. This means primarily the research, 
demonstration, training, and experimentation knowledge produced through contracts 
and grants sponsored by ORD, excluding evaluation research sponsored by OPE. 
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The topic areas represented by ORD contracts and grants reflect the 
primary manpower issues of the day. From an earlier emphasis on study of 
and programs for the benefit of those already within the labor market 
(e.g., the effects of automat ion) , which reflected the statutory language, 
emphasis has shifted to expanding the marlcet by extending services to the 
disadvantaged and under-employed (e.g., the emphasis on minorities, employment 
for welfare recipients, training for youth, women, etcj. 

As we move to those pieces of knowledge with which the Division works 
most actively, we see two different patterns emerging: first, there Is the 
knowledge produced by ORO grants and contracts coming from the other divisions 
(*'RSD on manpower"); and second, that produced by contracts to develop new or 
better ways to Insure that the first type of information gets disseminated 
and used ("RsD on ut 1 1 Izatlon'^ . In day to day activity, however, more total 
staff time appears to be spent In assisting in the dissemination and utiliza- 
tion of manpower RSD, and linking with the project officers In other divisions 
to develop dissemination and utilization activities. 

The "buddy'* efforts. In the recent past, were organized by project 
officers (one staff member working with most or all of the projects of a few 
project officers), but recently the trend has been toward organization by 
topic area (staff member taking projects within his or her fields of expertise, 
thus working with more project officers). A wide variety and a large number 
(about 190) of RGD projects are thus linked to by Division staff, running the 
subject matter gamut from black employment to vocational education, women's 
programs to WIN research conferences. Much of the involvement comes as these 
projects near completion, and usually consists of deciding (with agency and 
research personnel) what to do to get which results to what potential users. 

There Is considerable variety among the DSU projects Initiated by the 
Division of R&D Utilization. Host, however, take the form of attempts to 
repackage Information. Included here are projects to produce Jargon-free 
summaries of R&D results, syntheses, and state-of-the-art papers. Tills 
activity allows the Division to cover, secondarily, the knowledge which Is 
available outside of Its mandate, although the state-of-the-art papers produced 
thus far have been limited to subjects where ORD Is the major producer of the 
R&D reviewed. Other work Involves exploring effective communication media: 
an attempt to target communication for special audiences, development of self- 
instructional courses using tape cassettes or films as a medium. The Division 
has also sponsored contracts designed to employ user groups In transmitting 
research Information. Special provision for publicity and dissemination of 
effective programs are built into some projects. Finally, some work has been 
done on conceptualizing the knowledge flow process (e.g., through conferences 
with outside experts In the field). In balance, however, more of the R&D 
initiated by the Division attempts to actually improve dissemination and use 
of knowledge than to investigate the D&U process itself. 
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H. AUDIENCES 



1 » Intended CI tents 



The intended clients as perceived by both Division of R&D 
Utilization staff and other staff within the Manpower Administration, include 
a complex system of multiple user groups inside and outside of the Manpower 
Administration. Policy maimers, researchers, professional manpower practitioners 
(ranging from program administrators at the federal level to state and local 
program operators), vocational educators and other government agencies, 
employers who participate in Manpower programs, the ultimate recipient of 
Manpower programs, and the general public are general user groups identified. 
These user groups obviously cut across agency lines, since the Manpower program 
Interfaces with a variety of other agencies (Vocational Education and Manpower 
Development and Training - MDT - in the Office of Education, Vocational Rehabil- 
itation in Social and Rehabilitation Services, etc.) as well as private assoc- 
iacions and organizations. It was emphasized that intended user groups In 
other agencies are not necessarily located at- the federal level; rather, the 
intended clients include the state counterparts of other federal agencies* 

ORD staff, particularly the staff of the Division of RSD Utilization, 
then have the responsibility of providing a flow of Information to 'Mnter* 
mediaries" In other divisions and agencies as well as to their perceived 
clients. This responsibility for multiple client groups was reflected In 
the perceptions that Division of RSD Utilization staff members have of 
audiences to be served: although the primary emphasis was placed on policy 
makers and program officers within MA, such varied user groups mentioned 
included practitioners outside of the Manpower Administration (state vocational 
education and MDT offices, local employers, private Industry, private associa- 
tions, and organizations), local government offices, and In a few cases, 
researchers. The Division staff members did not view the general public and 
th^ beneficiaries of manpower services as clients within their realm of activity. 



2. Actual CI lents 



In addition to ascertaining the Intended client groups df>the 
Manpower Administration, an attempt was made to assess the actual gn^ps 
served by the staff of the Division of R&D Utilization and others. To this 
end, interview responses were screened to identify types of media us^d to 
transmit Information, types of user groups to which such media were directed, 
and also to identify the weight of efforts to various user groups. 

It Is noteworthy that a wide range of media Is employed to reach various 
user groups, both oral and written,. The media range from reports themselves, 
to R&D Information that has been transformed to varying degrees (monographs, 
memoranda, etc.) > to various forms of oral transmission (meetings, conferences. 




Taken from a specific question on the questionnaire: ''Who are the intended 
clients of such research?'' 
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informal personal contacts). Oral modes of reaching users were most often 
mentioned by Division staff members as a source of transmitting information, 
and this fact relates to the emphasis placed on this medium by various 
Division staff. In relating types of media enployed to specific types of 
user groups, we can attempt to define the actual user groups and emphasis 
placed on them in terms of the different types of activities employed. 

a. Pol i cy Makers 

Although policy makers were a primary intended client group of both 
Division staff and other staff, some of those outside of the Division are 
more closely linked to the policy group by their job roles. The Division, 
in fact, views ASPER and OPE as channels to the policy makers, and attempts 
to feed research information to the policy makers through these channels 
(e.g., uglng Advance Research Briefs) , However, with thei r indirect linkages, 
the staff of the Division of R&D Utilization have noted that this policy user 
group has not been adequately served for a number of reasons: staff size and 
time limit their ability to cover all client groups adequately; some Division 
staff members did not feel that they had adequate knowledge of the policy 
concerns in the Department of Labor. 

b. Practitioners 

A wider variety of means were employed to reach practitioners, 
particularly those within the Manpower Administration. The range includes 
everything from outstanding reports, to handbooks, to oral modes. It should 
be noted that the actual mode employed to reach practitioners by Division 
staff is carefully selected on the basis of how wide or intensive the impact 
of the mode will be. Dissemination of reports, periodic listings of reports, 
the annual projects book, etc., are employed to reach the widest possible 
range of Manpower practitioners at various levels, from USES staff to local 
mayors' offices. Other means, such as conferences, handbooks, and even 
on*site visits of demonstrations have been used by Division staff to impact 
smaller groups of practitioners. 

c. ORD Staff 

This "unintended** client group also obtains information and services 
from the Division of RsD Utilization with informal, personal contacts by far 
being the most common means used. The **buddy system** serves as a vehicle 
for these contacts as well as other, more formal meetings. One staff member 
described the relationship between the Division of R&D Utilization and other 
divisions in ORD as **interdct i ve**, with many utilization efforts crossing 
Division boundaries. * 

d. Researchers 

Different modes of communication were used in reaching this group, 
although for the purpose of Informing them of research, written modes were 
most common. Summary modes such as the annual research projects book are 
prime media. Although researchers, as a group, were not mentioned frequently 
as intended clients, it was stated that a large proportion of requests for 
— ^^^^ came from universities. 
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e. Consumers and the General Public 



Two user groups which were reported as being sent the least 
Information output from ORD and the Division of ReD Utilization are the 
ultimate beneficiaries of programs Improved through RSD (the job seekers) 
and the general public, mainly because the Division does not consider these 
groups to be part of their primary client system. These user groups would 
require more general Information, and the Division Is not equipped with the 
resources to handle the function of providing such general, non-technical 
information on a systematic basis. Nor would doing so contribute much to 
Improving Manpower policies and programs, which is ORD's overriding objective. 

I I . RESEARCH UTILIZATION BRANCH/SOCIAL AND REHABILITATION SERVICE 
A. LEGISLATIVE MANDATE 

Legislative authorization for the research and demonstration (RsD) 
programs of the Social and Rehabilitation Service (SRS) comes from a variety 
of sources. Section 4(a)(1) of the 195^ amendments to the Vocational Rehabil- 
itation Act authorized research to seek solutions to vocational rehabilitation 
problems.* Section 1115 of the Social Security Act (SSA) authorized demon- 
stration projects In the area of public welfare administration to be funded 
only to state agencies, and Section 1110 authorized R&D designed to help solve 
problems besetting welfare clients; the latter authorization includes support 
for eight Regional Research Institutes in Social Welfare. Section 426 of the 
i960 amendments to the SSA authorized funds for research In the area of child 
welfare, and Title II, Section 202 (8) and Title IV, Section 707 of the Older 
Americans Act authorize research in the general area of aging. The Agricultural 
Trade Development and Assistance Act (P.L. 480) authorizes use of U.S. government 
owned foreign currencies for research in other countries. 

The budget for the SRS research programs has increased from $51 million 
to $59 million in the last three years. For FY 1970, Rehabilitation Research 
included a large share, with about $20 million for research and $10 million 
for the Research and Training Centers. For FY 1973, the SRS research budget 
will be $64 million. 

Legislation authorizing dissemination of researcn and information includes 
the following: Section 7(a)(3) of the Vocational Rehabilitation Act (VRA) for 
information. Section 7(c)(2) of the VRA for research. Section 202 (1&6) of the 
Older Americans Act, and Title III, Section 304 of the Juvenile Delinquency 
Control and Prevention Act. In addition, the Congress ional ly-constituted 
National Citizens Advisory Committee on Vocational Rehabilitation, and the 
administratively-authorized Task Force on Research Utilization both have 
strongly urged more comprehensive programs of research utilization in order to 
me'et. pressing client needs. 



* The Research Utilization Branch (RUB) has worked primarily with research 
sponsored under this legislative authorization. Funds for RUB-sponsored 
Q projects also largely came from this source. 
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B. PURPOSE OF RESEARCH AND UTILIZATION ACTIVITIES 

John D. Twiname, Administrator of SRS, has described the general mission 
of SRS as that of enabling ''America's handicapped people to move from depen- 
dency, alienation, and deprivation toward social productivity, self generation, 
and Independence.** The research and demonstration programs are to support 
this mission. However, the **handi capped** encompasses a wide range of clients, 
as reflected in the different areas of research authorized: aging, chi 1 d we Ifare, 
welfare and public assistance, and rehabilitation. Thus, most of the research 
Is of an applied nature, given the mandate under which the RSD program operates. 

With the wide range of research activities In SRS, RUB has developed 
the following goals: 1) to improve RSD Information activities within SRS; 
2) to help assure that research Is planned, conducted, and reported so as to 
maximize the lllcelihood that effective results will be produced; 3) to 
establish 1 inlcs in the field between research and practice; k) to generate 
new Icnow^edge on RU, the diffusion and adoption of innovations, and the use 
of research results to improve policies, programs, and practices; 5) to 
create in service agencies a general atmosphere conducive to change, a will- 
ingness to use available resources and Icnowledge, and a capacity for ongoing 
renewal within agency and program; and 6) to w>rk and plan toward an overall 
RU system that is conceptualized and tailored to fit SRS circumstances and 
needs, and that will bring better overall utilization of SRS research results. 

C. ORIGIN 

In 1966, a Task Force .was convehed in the Vocational Rehabilitation 
Administration (VRA) charged with recommending measures to identify and 
put effective research results to use. In July of 1967i before the recommen- 
dations came out, the creation of the Research Utilization Branch (RUB) was 
announced in an administrative letter from Commissioner Mary Switzer. 

There were some activities in the area of dissemination and utilization 
even before the creation of the presenj^ RUB. The Branch grew out of a small 
editorial unit In the rehabilitation research program which distributed a 
**Rehabi 1 1 tat ion Service Series,** similar to the present Briefs. In }Sik^ the 
VRA sponsored a study on the **Utinzatlon of Applied RsD Results** by Dr. Edward 
Glaser.* Results of **Selected Demonstrations** were disseminated and app^c^ox- 
imately 20 conferences designed to bring research findings to researcher^\irnd 
practitioners were conducted through I968. Some of the early efforts also 
included cataloguing and dissemination activities. However, it was with the 
administrative authorization for the creation of a utilization unit that 
utilization activities within VRA were focused. 

Various events influenced the growth of RUB. Early In 1968, the Tasic 
Force and RUB were authorized to implement the 13 recommendations of the Task 
Force Report. It was not until 1969, however, that specific projects were 
designated for sponsorship by RUB and a separate Review Body was established 



^Thls early study (reported In Glaser, et al., I966) was used by some 
other federal agencies in beginning their D6U activities. 
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for the Branch. Projects sponsored In the first year of funding Included the 
Inltiatron of nine Research Utilization Specialists (with one in a State Voca- 
tional Rehabilitation Agency within each region) and the development of one 
of the two existing Research Utilization Laboratories. These projects reflected 
the initial focus of RUB on developing linlcages to the field in order to better 
relay messages to practitioners. 

Around the same time that RUB was created, larger organizational changes 
were occurring that affected the scope of the Branch's activities. In I967, 
various programs, Including the Vocational Rehabilitation Administration and 
the Welfare Administration, were merged to form the Social and Rehabilitation 
Service (SRS) . The separate research programs of the administrations also 
were gradually merged into the one Office of Research and Demonstrations (ORD) 
within SRS. During 1971, centralization of all ^research programs occurred, 
although the RsD programs still remain somewhat discrete. 

With this merger, the Research Utilization Branch became part of one of 
the research divisions of ORD; also at this time, the need for utilization 
activities among all the formerly separate research programs was expressed. 
The National Citizens Advisory Committee on Vocational Rehabilitation In 1968 
recommended that research utilization become a normal part of the SRS research 
program and that information systems be expanded in SRS. In 1971 an In-house 
Task Force was created to look at the question of utilization of ^RS research; 
recommendations lve re largely directed to organizational changes. As the 
concern has grown for utilization of research across research programs in SRS, 
the RUB has informally expanded Its activities to include D&U of welfare 
research and other areas of research beyond rehabilitation research. 

A reorganization is presently pending In SRS that could have some effect 
on D&U efforts. The nature of the divisions In ORD may change to reflect 
various functional areas, e.g., employabi 1 1 ty and self support, rather than 
the present mix of divisions concerned with grants, contracts, or intramural 
research. There is also a possibility that the position of RUB In the organ- 
izational structure may change to reflect the increasing concern for SRS-wide 
utilization efforts.* , 

0. HIERARCHY IN THE SOCIAL AND REJj^B I L I TAT I ON SERVICE 

SRS is only one of the major program areas of the Department of Health, 
Education, and Welfare (HEW). The other agencies within HEW are responsible 
for other major program areas. Over all these agencies are offices of the 
Assistant Secretaries which provide staff services and policy advice to the 
Secretary of HEW as well as to the agencies within HEW. 

SRS is an umbrella organl;?atlon, with the policy makers in the Adminis- 
trator's and Deputy Administrator's office providing guidance for the bureaus, 
or operating programs, and the centralized administrative offices which lie 
between the program and the policy functions. SRS is organized 

around common clients or populations rather than around a discipline or field, 
in other words, around the user rather than around an underlying conceptual 
frame of reference. 
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* As of July 17, 1972, the Research Utilization Branch attained division status. 
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The bureaus operate under different legislative mandates' and their 
program structures and client groups vary somewhat, in spite of overlap of 
some services to different client groups. The Administration on Aging is 
responsible for developing and expanding services to the elderly, including 
over 1,200 senior centers at the local level. The Community Services Adminis- 
tration provides technical assistance and guidelines on social services for 
families and children. The Assistance Payments Administration Is primarily 
responsible for public assistance programs. The Medical Services Administra- 
tion oversees the programs of both vocational rehabilitation and developmental 
disabilities. The remaining bureaus include the Youth Development and Delin- 
quency Prevention Administration and the Cuban Refugee Program. 

As the process of decentralization of program responsibilities from the 
central organization to the regions has been underway In SRS during the past 
few years, the role of the program people at the federal level has been changing 
to that of providing priority and management guidelines to the regions and 
states, insuring that state programs are in compliance with federal statutes 
and regulations, and providing new training skills and programs to match new 
priorities of tlie agency. 

Along with the Administrator and Deputy Administrator and the bureaus 
in SRS, there are also the three offices of the Associate Administrators which 
are located between the other two personnel groups and provide staff assistance 
to both. Most of the research conducted and sponsored by SRS occurs within 
the Office of Research and Demonstrations (ORD) which is part of the Associate 
Administrator's Office for Planning, Research, and Training. Included In ORD 
are six divisions which have varying sources of legislative authorization for 
their research programs. Within the Division of Research and 

Demonstrations, there are four branches, three of which have different legis- 
lative sources for funds. The Research Utilization Branch does not have a 
separate legislative source for its funding, but receives funds from the 
research money which is pooled at the ORD level. 



E. PRESENT OPERATIONS OF THE DGU UNIT 
1. Staff 

The Research Utilization Branch, at the time of interviewing, included 
the Branch Chief, three other professional staff members, one Research Adminis- 
trative Assistant, and one secretary. Another professional staff member Is 
in the process of being assigned to RUB on a detail basis to develop plans for 
SRS telecommun feat ion efforts. The baclcgrounds of the staff members vary from 
expertise in the area of audio-visAjal communication to more general prior work 
experience in other parts of SRS. 
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2. Funding Base 



Money for RUB's RsD efforts comes from the research budget which 
is pooled at the ORD level. Most funds RUB has received from this pool came 
from rehabilitation-based authorizations; in turn, RUB had worked primarily 
with the rehabilitation research in the past. The year I969 was the first 
in which projects were specifically sponsored by RUB; the RU budget has 
Increased from ].]% of the total R&D budget in I969 to 1.7% in 19/2. 

Generally speaking, ORD has moved from a "review" process to a 
process of "concurrence" In establishing allocations for RsD efforts. The 
steps taken to allocate ORD research funds to the various divisions and 
branches are encompassed in the management review process of SRS. 

3. Functions 

Branch responsibilities have expanded over time to include utilization 
efforts, telecommunication efforts, and efforts to establish an Information 
system for SRS as a whole. Given these responsibilities, the activities of 
staff members fall into the following general areas: 1) policy formulation; 
2) planning and development of In-house and contracted efforts; 3) managerial 
duties, e.g., monitoring of contracts. With a relatively small number of 
personnel, the RUB staff have assumed a "functional" approach to Branch activ- 
ities and duties of the staff members vary from week to week. 

The clerical staff of RUB are also involved In DSU activities. The 
Research Administrative Assistant spends almost all of her time distributing 
reports and maintaining controls over projects, since RUB is responsible for 
obtaining final reports of rehab? 1 1 tatlon research after the termination of 
these projects. She also maintains monthly acquisition lists of final rehabil- 
itation research reports, distributes the lists to staff In SRS, and helps 
monitor the abstracting contract. 

Non-Branch staff members' perceptions of RUB*s responsibi 1 It les and 
functions varied depending on how much contact and work the outside staff 
have had with RUB. The bureau staff who have worked most closely with RUB, 
Rehabilitation Service Administration (RSA) staff members, viewed RUB staff 
as "brokers" or "middlemen" between the RSD staff and the program staff In 
RSA. Some respondents in other bureaus viewed RUB's function as that of 
communicating what has been done and "getting Information out." Others perceived 
no functions performed by RUB In the past that pertained to research relevant 
for the! r bureaus. 



F. OTHER SRS D&U EFFORTS 

The Research Utilization Branch has not been the only unit concerned with 
D&U, particularly since It has had a formal mandate to utilize results of 
rehabilitation research only, and has used funds primarily from the rehabili- 
tation research program. The other RsD divisions and branches in ORD have been 
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responsible for DSU activities to some extent, although most efforts have 
been concerned with dissemination* Beyond dissemination of final reports, 
some divisions and branches have conducted conferences and workshops with a 
utilization focus. Within the Division of Intramural Research in ORD, a 
Research Analysis and Utilization Branch (RAUB) was originally set up to pull 
together and analyze social science research in the area of welfare with the 
purpose of identifying needed areas of research and implications of existing 
research for policy makers. However, RAUB presently exists more or less '*on 
paper" due to decrease in staff size and the pending reorganization. 

Aside from the D&U efforts of the other units in ORD, some program people 
in the bureaus feel responsibility for utilization of research results. The 
training programs in the bureaus were seen by program staff as a key place to 
feed out research products to the practitioners, and expansion grant funds, 
administered by the bureaus, were also viewed as a way to link up to the 
research program. 

The Office of Public Affairs (OPA) , an SRS-wide unit, and the Public 
Information Offices in each of the bureaus ha\'e responsibilities for dissemin- 
ation of more general information to the public* All of the staff members in 
RUB have specific links with OPA; for example, one RUB staff member has liaison 
with the editor of SRS Newsletter to Insure RSD input into this medium. RUB 
also views the dissemination function as a responsibility of the contractors 
and grantees themselves. 



G. THE KNOWLEDGE BASE 

Most of the research knov:ledge produced In SRS is sponsored by ORD* 
The reorganization of 1967 ultimately moved research responsibility from the 
line administrations to the centralized location in ORD, which now has divisions 
and branches which are linked to the program administration areas. Therefore, 
RSD information should be responsive to the needs of the line administrations, 
in 1970, rehabilitation R&D received the largest share of R&D projects and 
funds and%/as conducted for four purposes: to add information useful to the 
fields of physical, mental, and social rehabilitation; to m3Ke existing programs 
more effective; to serve administrators of these programs; and to stimulate 
and guide legislation. 

The primary role of RUB is th^t of improving the dissemination and utiliza- 
tion of the rehabilitation RSD. . Increasingly, RUB has been handling alt of 
the RSD sponsored by SRS in a nujmber of efforts: an annotated bibliography 
SRS Research ' (1971) ; an abstracting and indexing contract (RUB sends all RSD 
to be included in NTIS); and RU requirements for appl i cat ions and continuation 
requests, used for all R&D programs in SRS. RUB has served as a point of 
coordination for D&U contracts and grants as well as conducting some In -house 
activities. 
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In FY 1970, 27 D&U projects were sponsored by RUB (ustng rehabilitation 
research funds allocated at the ORD level), including two grants, for Research 
Utilization Laboratories and nine pilot Research Utilization Specialists. 
Contracts are also let for abstracting and indexing final reports and develop- 
ment of the SRS-wide information systes*,, for state-of-the-art reviews, utiliza- 
tion conferences, and specialized paclcaging. RUB also prepares the - RSD Brief 
Series , highlighting results and implications of research. 

In conclusion, we should note the relation of RUB to research projects 
sponsored elsewhere in ORD. Most of RlB's effort came once the project was 
completed and "turned over" to the Branch for development and execution of 
such DSU activities as Judged warranted. RUB has long been actively involved 
in the development and revision of guidelines for final report writing. 
Recently, however, the influence of RUB has been expanded to the earlier stages 
of research development by means of staff involvement in planning the annual 
RSD Strategy and by required use of RUB-produced RU guidelines for research 
applications and continuation requests. 



H. AUDIENCES 

1 . Intended CI icnts* 

The intended clients or users for the information which RUB either 
disseminates or causes to be disseminated (through its contracts and grants) 
range through several different systems. Various professional or practitioner 
groups, primarily in rehabilitation, were mentioned frequently 'by RUB staff 
as their most important clients. Other federal staff members (chiefly within 
SRS) are also important intended clients, in so far as they administer programs 
which affect practitioners and the ultimate clients (those in need of SRS 
program services) directly. Here, too, policy makers at all levels become 
potential targets for research knowledge. Universities and training centers 
are addit lonal important target groups. 

« 

.Given the past rehabilitation emphasis of RUB, RSA has been the SRS 
adninistration with which RUB has linked most closely. Occasionally, infor- 
mation provided to RSA staff Is passed on directly to the bureaus' important 
clients; research knov^ledge may reach the "ultimate" clients Indirectly In 
the form of program emphases. 

2. Actual CI ients 

In our interviewing process It was difficult to separate intended 
from qctual clients, particularly since a complete accounting of all commun- 
ication activities of each staff member was not solicited. However, from the 
interviews It was possible to obtain general Indications of wh|ch client or 
user groups received emphasis in RUB activities and which medl^M were employed. 



* "Clients," as used In this report, means 'information us'^rs". I.e., clients 
of DSU activities. 
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In genenl, the actual clients of RUB are primarily practitioners, SRS 
staff, and more recently, policy makers. Regarding practitioners, an impor- 
tant principle appears to guide RUB's activities: given the size and work 
load of RUB, most dissemination efforts to reach this group appropriately 
should not be and are not undertaken directly by the Branch itself. Instead, 
project activity (e,g,, D6U contracts and the original researchers themselves) 
should undertake the actual communication task fn reaching pract i t ione rs « 
RUB is thus freed to spend more time preparing materials for dissemination, 
to communicate with SRS staff and policy makers, and perhaps most importantly, 
to plan future DSU activities by bringing together theories and models of D6U 
with knowledge of the topics, needs, knowledge, and clients of SRS, 

a. Pol i cy Makers 

There has been a recent attempt to get more information to policy 
makers in general. Written materials, e«g«, R&D strategies, summary and 
position papers, etc., have served as a primary medium of reaching policy 
making staff in SRS and HEW, The D6U effort for policy makers has shifted 
informally to RUB and other ORD staff with the cut In the Research Analysis 
and Utilization Branch (Division of Intramural Research), The management 
procedure in which bureau, regional, and ORD staff are involved In developing 
the R&D Strategy may serve as a means of relaying R&D information to policy 
makers at various levels. 

b. Practitioners 

Many different mechanisms are employed to reach this group (here 
defined as state and local, public and private, topic experts e.g., 
rehabilitation counselors and administrators of state and local programs). 
It is for this group th|at RUB attempts to develop linkage mechanisms outside 
of itse)f. Current efforts of RUB show a shift of concern away from dissem- 
ination activities and toward the utilization part of the D&U process. Three 
related processes fit In this current interpersonal emphasis to reach practi- 
tioners: the two RU Lab)^, nine RU Specialists in pilot states, and interface 
conferences which bring together researchers and practitioners. We do not 
intend to give the impression that RUB only links to practitioners through 
Interpersonal, outside activities. A large proportion of RUB's stafT time 
goes into the preparation i^f written information (either done in-house or 
through contracts or grants outside, e.g.. Indexing, abstracting, and summar- 
izing contracts). As a general conclusion, RUB appears to be exploring, 
within its staff and budget \const ralnts , the effectiveness of several different 
models for communicating research knowledge to practitioners, and for getting 
r such communicated knowledge pyt Into use In the dally operations of users. 
This Indicates an awareness of both theories and models of D&U, and of needs 
and conditions of researchers and potential users. 
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c. SRS Staff 

\ 

Most of RUB'S contacts in SRS have been either within ORD or with 
RSA. Upward direct communication to policy makers as clients appears to 
flow more through ORD than *RSA channels, following the chain of command to 
the organization of which RUB is a part. Written materials are the primary 
medium, but interpersonal links do exist to both ORD and RSA and, because 
of more limited activity, other administrations to a lesser degree. Other 
ORD project officers have also developed informal comnuni cat ions with bureau 
staff in SRS, given that they are the ones who are most directly involved 
with projects and who have good knowledge of expected project results. 

d. Researchers 

In their role as project officers for RUB-sponsored research, 
Branch staff have frequent contact with a small portion of the research 
community. Communication appears about as frequent with researchers in 
search of topics as with those who are already funded. Beyond this admittedly 
small number of researchers, RUB has an impact on rehabilitation researchers 
through the DSU guidelines It has developed and revised for final reports. 
The guidelines which RUB has recently developed for RU input in all SRS 
research applications and continuation requests will impact an even larger 
nun6er of researchers. 

e. Consumers and the General Public 

In collaboration with OPA, RUB has done much In this area. A 
half-hour television program has been written for a nationwide network, and 
a RUB staff member has assisted in developing videotapes on various subjects. 
Project Alert, in which assigned staff will relay RSD information to the media, 
is being built up gradually. The written RSD Brief Series and more recently, 
the audio-visual series are considered to be di rected to this audience as 
well as to others. Some requests for information from the public do come to 
RUB and are answered by staff members with existing written materials or 
referrals to other SRS offices, the grantees, or NTIS. 
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III. MENTAL HEALTH SERVICES DEVELOPMENT BRANCH/NATIONAL INSTITUTE OF MENTAL 



HEALTH 



A, LEGISLATIVE AUTHORIZATION 

Through Public Law 911, authorization was given in 1956 for the Mental 
Health Project Grants Program of the National Institute of Mental Health (NIMH)*« 
This program was established to provide funds for demonstrations of improved 
* ways to deliver mental health services. Funding levels for the whole Grants 
Program have remained relatively stable over the last three years at about 
$1^1 million; the core of the program in the Mental Health Services Development 
Branch has funds of about $7^ million out of that total. 



B. PURPOSE OF RESEARCH AND UTILIZATION ACTIVITIES 

Dr. Bertram S, Brown, Director of NIMH, has described the Institute's 
mission as follows: **to develop knowledge, manpower and services to treat 
and rehabilitate the mentally ill, to prevent mental illness, and to promote 
and sustain mental health.** Thus, a ''trinity" of research, training, and 
services has been important In the development of the agency's mission. 

The research and development mission fostered by the Mental Health Services 
Development Branch Includes a three-stage process: 1) evaluating the needs, 
gaps, and problems in the delivery of mental health services; 2) searching 
for appropriate existing solutions or developing solutions through research; 
3) fostering the diffusion and adoption of solutions. The emphasis of the R6D 
mission is to promote their Division's goal of the improvement of the delivery 
of mental health services. 



C. ORIGIN 

Before 1966, the Mental Health Project Grants Program was attached to what 
is now known as the Division of Mental Health Service Programs. In 1966, this 
Grants Program was moved out of that component as the Division did not carry a 
research mission; instead, this Division focused on administering grant programs 
which were designed to Initiate and fund staffing and construction for local 
community mental health centers and to provide project support for mental 
hospitals . 



* Other legislative authorization for research exists in NIMH; however, the 
Mental Health Services Development Branch primarily works with research of 
the Mental Health Project Grants Program (especially with the services R&D 
portion of this Grants Program). This Grants Program comprises about 19% 
of the total NIMH research allocation. 
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The 1966 transfer of the Mental Health Project Grants Program Into 
what Is now known as the Division of Extramural Research resulted In the 
Grants Program becoming the Applied Research Branch. It remained in the 
Applied Research Branch until 1970, at which time a portion of the Branch 
staff and over 50% of the funds from the Grants Program (for the more service- 
oriented research) were moved into the Mental Health Services Development 
Branch. In I97O then, the present Mental Health Services Development Branch 
was created by the merger of staff from the Applied Research Branch and staff 
already in the HHS Program Division. This merger was important in that it 
brought together staff with different expertise and backgrounds and allowed 
for a **marriage*' between a research program and a service-support program for 
the whole MHS Program Division. 

The staff who moved from the Applied Research Branch brought with them 
knowledge of RsD program development. In 1966, an attempt was made to review 
the findings of the first ten years of the Mental Health Project Grants Program; 
however, results could be obtained for only kO% of the terminated projects. 
This discovery led to project monitoring by staff to insure the completion of 
projects. Also, the dissemination of project information became an important 
goal in the Grants Program. All projects for which final reports were received 
in 1967 were evaluated in terms of the amount of dissemination that had occurred. 

In NIMK-sponsored studies, it was found that "Innovators" rarely obtain 
their ideas from written materials; therefore, the concept of utilization was 
introduced. Through contracts and in-house research, studies were conducted 
on the factors that influence the utilization of projects. Some of the results 
v^re employed in experimental efforts and criteria were developed by which to 
rate the uti 1 Izabi 1 ity of specific research applications. Beyond utilization, 
another concept recently has been introduced: in an attempt to improve the 
delivery of services, project grants are to be used as instruments in proirotlng 
o rgan I z at i ona I chan ge . 

These then were the concepts that persons involved in the Grants Program 
brought with them into the Mental Health Services Development Branch. On the 
other hand, those staff members who had been in the Division of MHS Programs 
possessed background in consultation through their experiences in administering 
support programs for the community mental health centers and mental hospitals. 

Even though the Branch has developed experience in fostering the diffusion 
and adoption of research results, it has not served as a D&U unit for all of 
NIMH research since neither this unit nor other units in NIMH have administrative 
or legislative authorization to provide such a function. Instead, the Mental 
Health Services Development Branch has defined responsibilities for research 
and development activities (including DSU) for services-related research. 



D. HIERARCHY IN THE NATIONAL INSTITUTE OF MENTAL HEALTH 

The National Institute of Mental Health (NIMH) is one of four organizations 
within the Health Services and Mental Health Administration (HSMHA) . HSMHA is 
the "health arm" of the Department of Health, Education, and Welfare. 



-64- 



NIMH has been described as a "flat" or "horizontal" organization, since 
there are basically only two types of units within the Institute. 

Located under the Director and Deputy Director are the offices which do 
not have grant money to dispense, but serve the primary function of adminis- 
tration, coordination, and evaluation of the major program efforts. For 
example, the Office of Program Planning and Evaluation (OPPE) serves the 
function of analyzing results of major progrannatic efforts in order to plan 
and initiate programs. The other offices include the Office of Administrative 
Management, the Office of Program Coordination, and the Office of Communi cat icns 

The divisions, which are located under the offices, possess the funds for 
grant programs of research, training, and service. There are three divisions 
In the Mental Health Intramural Research Program which are involved exclusively 
In Intramural research in clinical and laboratory settings. There are six 
divisions which sponsor extramural grant programs. The Division of Extramural 
Research has a primary function of supporting research which ranges from very 
basic clinical research to applied research. The Division of Manpower and 
Training Programs has responsibility for administering programs of support for 
the training of mental health personnel. The Division of Special Mental Health 
Programs has centers which are organized around special mental health problems, 
e.g., suicide, and which administer programs that include various combinations 
of research, training, and services. The Division of Narcotic Addiction and 
Drug Abuse administers research, training, and service grant programs around 
the problem area of narcotics and drug abuse. The National Institute of Alcohol 
Abuse and Alcoholism administers a combination of programs somewhat similar to 
the Division of Narcotics and Drug Abuse, focusing Instead on the problem of 
alcoholism. The Division of Mental Health Service Programs administers and 
coordinates various programs focused on the development and support of nation- 
wide mental health services. Included in these programs are the grant programs 
for the construction and staffing of local community mental health centers, 
funds to public mental hospitals, as well as the provision of consultation for 
various groups. Joined to these functions Is the research and development 
program of the Mental Health Services Development Branch, one of the four 
branches within the MHS Program Division. 

Decentralization has been occurring within the NIMH-admlnlstered service 
programs and the ten regional offices have had increasing responsibilities for 
administering and monitoring the various service grant programs. This decentral 
Izatlon has allowed the central staff more time to become Involved In the devel- 
opment of guidelines and consultation to the regional office staff and to state 
and local clients. 



E. PRESENT OPERATIONS OF THE RSD UNIT* 
1. itaff 

At the time of interviewing, the Mental Health Services Development 
Branch (MHSV) staff Included about 18 professionals, expert In various substanti 

* The Mental Health Services Development Branch has described Itself as an 
Q "R&D" unit) rather than a DSU unit. Their concept of R&D, however, includes 
JC dl^^usion and adoption. 



areas such as psychiatry, psychology, and social work. Most of these staff 
members are employed at the grade level of GS-15; in fact, It was noted that 
the Branch contains one of the largest pools of this grade level of staff 
within any NIHH branch. 

2. Funding Base 

The research budget for the Branch and other research units In 
NIHH generally is determined by the funding levels of the previous year. The 
MHSV has had an annual research budget of approximately $7^ million for 
grants for the last three years. An additional supplement of $3 million has 
been requested for the development of the children's service area, which would 
put their annual research budget at about $10 million. The Branch has additional 
contract funds of $'»0,000 which are used for funding publications, conferences, 
and professional consulting services. The total annual research budget for 
NIMH is approximately $120 million which accounts for over 1,500 research projects 
these figures do not include some 300 intramural research projects. 

3. Functions 

The major function of the MHSV has been described as that of research 
and development^ which encompasses the entire process ranging from the develop* 
ment and stimulation of research projects tb diffusion and adoption activities. 
Staff activities fit Into three major areas: l) consulting In the field, e.g., 
responding to requests for giving talks, serving as technical consultants for 
potential grant applicants, consulting with staff of mental health centers and 
other clients; 2} responding to In-house requests for writing reports, partic* 
Ipating In task forces and other committees, etc.; 3) monitoring of ongoing 
projects. The percentages of time spent on each of these activities varies 
among Branch staff; however, it was clear that considerable amounts of time 
were spent responding to In*house requests (percentages ranged from 15% to 
over 60%). 

The Involvement of Branch staff In division level and Him level 
responsibilities In addition to Branch responsibilities Is a result of the 
Branch structure. MHSV Is organized around functional program areas, e.g., 
children's mental health. One professional staff person is responsible for 
each of the program areas. Including the coordination of efforts around that 
area. Thus, staff members provide professional expertise In their specific 
program area; additionally, they may be called upon to assist In division and 
other NIMH activities. 

NIMH staff members outside of the MHSV were asked to describe their 
relationship to the Branch and their perceptions of the Branch's functions. 
Staff in the same division viewed the MHSV as providing important contributions 
in the area of D&U as well as providing contributions to research on services. 
However, most of the staff outside of the division did not recognize the MHSV 
or any other unit as having sole responsibility for dissemination and utillza*- 
tion activities and did not report any systematic relationship with the Branch. 
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F. OTHER NIMH DSU EFFORTS 



Although other NIMH divisions and offices have initiated some efforts 
in the area of D&U,.it appears that most of these efforts are in the area 
of dissemination (e.g., paclcaging information, providing storage and retrieval 
facilities for available knowledge). For example, the Division of Narcotic 
Addiction and Drug Abuse has defined as part of its responsibility stimulating 
the "communication of appropriate information and educational material through 
the development of conferences, committees, publications, and use of public 
media.*' The National Institute of Alcohol Abuse and Alcoholism has defined 
a similar responsibility of communication for itself. 

The centers in the Division of Special Mental Health Programs also have 
been involved in some D&U activities. For example, the Center for Studies of 
Crime and Delinquency has used contract money and some administrative supple- 
ments to encourage the production of state-of-the-art papers, manuals, and 
conferences. 

These DSU efforts are decentralized and are focused primarily on the 
research specific to the problem areas of concern In the various divisions. 
However, there are some dissemination efforts that cross division lines, and 
such efforts are located in some of the offices. Within the Office of Program 
Planning and Evaluation, the Program Analysis and Evaluation Branch has respon- 
sibilities for assimilating information that has been produced through various 
NIMH efforts. The Office of Communications has been charged with the respon- 
sibility of providing general information to the public as well as more special- 
ized types of Information. The National Clearinghouse for Mental Health Infor- 
mation within this Office has the responsibility of ''maintain ing cognizance 
over all mental health Information'* and has as its mandate the "prompt and 
effective dissemination of this Information to all individuals and organizations 
in mental health." 



G. THE KNOWLEDGE BASE 

MHSV has a dual nature in that one part of the Branch is involved primarily 
with improving service delivery and includes topic area experts in such fields 
as community, rural, and child mental health, whereas a smaller portion of the 
Branch is more active in research on the D&U process. 

Staff members involved In improving service delivery are each expert in 
some one specialty and must monitor new developments In that field, relying 
on individual initiative and personal information resources. Useful knowledge 
for these staff members comes from the wider professional literature as well 
as from MHSV-sponsored projects. Grants are administered by MHSV for developing, 
pilot testing, and promoting the utilization of new service delivery mechanisms 
(e.g., demonstrations on cooperative nutrition and health programs, child 
advocacy, monitoring of service delivery system performance, training institutes, 
etc*). Staff serve as project officers and as general linkers to NIMH and 
outside for the lnfp_rmatipji these projects produce* 
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Thus, these staff members form a bridge between NIMH, their ''clients" 
In the delivery system, and knowledge produced both within their field and 
within NIMH. This role is a complex one which centers a great deal of the 
responsibility for Information flow directly on the staff member, who thus 
strives to maintain his grasp on the scientific and practical knowledge base 
while at the same time serving as project officer, proposal instigator and 
reviewer, knowledge transformer and summary writer, user progress and need 
monitor, and finally, a '"warm terminal" between clients and knowledge. We 
found that some staff members were using information-organizing services 
(e.g., the National Clearinghouse for Mental Health Information), but that 
others were not; there does not appear to be any overall MHSV activity designed 
to serve as a knowledge surveillance mechanism for these staff members. 

A few members of the Branch are more directly Involved with research on 
the D&U process Itself across topic area boundaries. Research on the D&U 
process can be divided into the following categories: 1} studies of past 
and present diffusion and adoption of NIMH-sponsored projects, such as projects 
which use previous NIMH projects as data, looking at literature citations to 
the projects and the proportion of past grantees who can cite users for their 
findings; 2) research on the research process, e.g., a project which examined 
project structure and process correlates of ultimate report quality; and 
3) work on identification of information needs among user groups. Another 
targe area of interest in MHSV Is in developing new evaluation methodologies 
to measure performance of mental health service programs. 



H. AUDIENCES 

1 . Intended CI ients 

Given that the MHSV Branch mission is to Improve the delivery of 
mental health services, both directly and through improvement !n the knowledge 
creation-processing-delivery process, the most important '"ultimate" client 
for MHSV's work should be those individuals and institutions who are in the 
business of providing mental health services. This group would include mental 
hospitals and mental health centers, and state mental health offices and staff. 
In reaching this group, a second client area becomes Important: those persons 
and units within NIMH who are producing knowledge through the research process 
and who control research through policy making. 

2. Actual CI ients 

a. Pol i cy Makers 

Much of the Branch's linkage with Federal policy makers comes through 
the use of staff In task force or position paper generation roles. In the 
specific field cf knowledge DSU» informal contacts with other units similar to 
MHSV (i.e., with applied constituencies), and manuals such as those on project 
evaluation are used to carry innovations; however, the basic-applied division 
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within NIMH would appear to make It relatively difficult for such a procedure 
to diffuse from applied areas into basic research programs. > A Policy Analysis 
Group has been set up in MHSV and the Division to discuss how to carry out 
implications of evaluation contracts for policy and practi ce . 

b. Practitioners 

Here we find a large part of the woric of MHSV. Practitioners in 
service delivery were mentioned as primary clients and in terms of how clients 
are reached, most staff members specified media designed to Impact this group. 

c. NIMH Staff 

Most of MHSV's contacts in NIMH talce place when Branch staff are 
called upon to perform both Division and NIMH level responsibilities. Branch 
staff members spend from 15% to 60% of their time performing these functions. 

d. Researchers 

Researchers, together with practitioners, make up the majority of 
MHSV's clients. MHSV can and does have an impact on researchers working In 
the applied areas of service delivery. For example, the project evaluation 
guidelines which resulted from an MHSV contract are now being applied to 
proposals, a quick way to change research practices. However, there is little 
Impact on NIMH baste research. The Branch does have funds available for 
research on D&U which, together with staff efforts to conceptualize and review 
the field, allow an information flow between the area of D&U research and the 
Branch. 

e. Consumers and the General Public 

Very little of the work of MHSV reaches the mental health service 
consumer public directly. The work of the unit will impact consumers to the 
extent that it can change practices among the primary client population for 
the Branch, the professionals involved in service delivery. 
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IV. NATIONAL CENTER FOR EDUCATIONAL COMMUNICAT ION/OFFICE OF EDUCATION* 

9 ■ 

A. LEGISLATIVE MANDATE 

Legislative authorization for research in the Office of Education was 
first given in the Cooperative Research Act of 1956 and was followed by 
authorization for research and dissemination through Title VII of the National 
Defense Education Act of 1958. With the expiration of Title VII, the provision 
for media research and dissemination was absorbed in the Cooperative Research 
Program. In 1965, Title IV of the Elementary and Secondary Education Act (ESEA) 
explicitly called for dissemination. After the Cooperative Research Act was 
repealed, money authorization was given under Section k02 of the General 
Provisions Act.^ There has been a ceiling set of million for FY 1973 and 
$68 million for FY 197^ for the functions that were previously performed under 
the Cooperative Research Program, such as statistical programs, planning and 
evaluation studies, and some dissemination activities. Other authorizations 
for dissemination within OE exist. 



B. PURPOSE OF RESEARCH AND UTILIZATION ACTIVITIES 

Near the close of FY 1970, the National Center for Educational Communica- 
tion (NCEC) was established to further strengthen the Office of Education's 
efforts to accelerate r'ational decision making and program improvement through 
the use of current knowledge, validated R&D based instructional materials and 
systems, and tested exemplary practices. NCEC has established the following 
five operating objectives: 1) to foster the spread and installation of vali- 
dated programs, practices, and products; 2) to strengthen the capabilities 
of state and local education agencies for disseminating and applying infor- 
mation for .educational improvement; 3)' to increase access to the educational 
knowledge base through the Educational Resource Information Center (ERIC); 
4) to provide interpreted, research-based information about significant educa* 
tional problems for educational decision makers and practitioners; 5) to 
conduct and support R&D on information dissemination and utilization. 



C. ORIGIN 

Under Title V) I of the National Defense Education Act of 1958, an Educa- 
tional Media Branch was established in OE to support research on media as well 
as to perform dissemination activities. In 1961, funds were made available 
from Title VII to experiment in developing ap ERIC-type system, and in 196^, 
an ERIC branch was created. 



* Recently enacted legislation has transfci-ed the D&U unit under study, 
the National Center for Educational Comrrunication, to the newly created 
National Institute of Education (NIE). 
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In 1965, with the passage of the Elementary and Secondary Education 
Act, the Division of Research, Training, and Dissemination was created 
withtn the Bureau of Research to administer an ERIC system. The seeds of 
the present NCEC program were begun in this time period: ERIC was developing 
on a decentralized basis, with Cjearinghouses being set up around the country 
to select and acquire literature on particular areas of education; centralized 
operations were performed by private firms including computer operations, 
marketing of microfiche, and providing computer searching services. 

In 1968, the name of the division was changed to the Division of Infor- 
mation Technology and Dissemination (ITD). Although the focus of the division 
remained on the development and maintenance of the ERIC system, there was 
growing concern over the direction and focus of dissemination activities. 
A resynthesis of the literature In the area of D&U Itself was seen as an 
additional need, and Dr. Havelock was funded to develop both an extensive 
bibliography and alternative models of D&U. 

In I969» the major objectives of the unit were still focused on ERIC: 
to develop an OE-wide dissemination and application system and to provide 
fast access to current information for use by OE staff.* However, a signif- 
icant change occurred to broaden and expand the activities and concerns of 
the unit. ITD became the Office of Information Dissemination (OID) and was 
separated from the research arm of OE* Then, in 1970, the unit director cut 
ERIC'S budget in order to use the remaining funds for more active dissemination 
efforts. This transference of funds reflected the shift of unit priorities, 
with the highest priorities becoming those of accelerating the spread and 
installation of validated practices and research-based products, and strength- 
ening the capabilities of educational organizations to communicate and apply 
validated practices. 

Also in 1970, the OID became the National Center for Educational Communi- 
cation (NCEC) and was set up to have two divisions: the Division of Practice 
Improvement and the Division of Information Resources, as well as a Copyright 
Administration staff. The Division of Practice Improvemjent funded projects 
idesigned to spread validated programs; the Division of Information Resources 
included ERIC, the Educational Reference Center (ERC) , and the Educational 
Materials Center. 

Transfer of tested practices, communication of information about tested 
knowledge and materials, and (heir nationwide adoption have become major 
priorities for OE, as evidenced by the establishment of NCEC at a key position 
for developing and directing pnajor OE-wlde communication programs. In June, 
1972, NCEC contained two divisions, each with two branches. The Extension 
Support Branch and the Dissemination Programs Branch were In the Division of 
Educational Extension Systems; ERIC and ERC were in the Division of Communi- 
cation Support. These two divisions reflected the overall objectives of NCEC, 
those being the development of an educational extension system and communication 
support. 



The predecessor of the present Educational Reference Center In NCEC 
developed out of the latter objective. 
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The refinement of NCEC indicated the growth of the D&U unit from the 
Initiation of ERIC and the more ^'passive" efforts of building access to the 
knowledge base to the development of specific branches concerned with valida- 
tion and more '^active*' dissemination and Installation efforts, as well as the 
longer-term development of linkages and person-to-person networks throughout 
the nation. 

/ 



D. HIERARCHY IN THE OFFICE OF EDUCATION j 

The Office of Education is In the Department of Health, Education, and 
Welfare. Located directly under the Commissioner of Education are five 
Deputy Commissioners, an Executive Deputy Commissioner, Executive Assistants, 
and an Office of Special Concerns. 

The Offices of Priority Management, Regional Office Coordination, Program 
Planning and Evaluation, and Administration are located under the Deputy 
Commissioner for Management. The Deputy Commissioner for External Relations 
oversees the Office of Legislation, the Office of Federal State Relations, 
the Federal Interagency Committee on Education, and the Office of Public 
Affairs. The Bureaus of Education for the Handicapped, Elementary and Secondary 
Education, and Adult Vocational and Technical Education are situated under the 
Deputy Commissioner for School Systems. Located under the Deputy Conini ss ioner 
for Higher Education are the Bureau of Libraries and Educational Technology, 
the Bureau of Higher Education, and the Institute of International Studies. 
Finally, NCEC was for a short time one of three National Centers located under 
the Deputy Commissioner for Development, the other National Centers being the 
National Center for Educational Statistics (NCES) and the National Center for 
Educational Research and Development (NCERD) . In addition to these three 
Natlcnal Centers, the Bureau for Educational Personnel Development and the 
Experimental Schools program are also located under this Deputy Commissioner. 
Most functions of two of the Centers, NCEC and NCERD, and the Experimental 
Schools program have. subsequently been absorbed by the new National Institute 
for Education; NCES and the Bureau for Educational Personnel Development remain 
within OE. \^ 

The bureaus and offices under the Deputy Commissioner^ are further divided 
into divisions. Each of these five major units supports programs and funds 
research concerned with the priority areas within their particular focus in 
the field of education. The regional offices serve a$ an operating extension 
of OE for service to and close working relationships with states and other 
recepients of federal educational aid. Increasing decentralization is a goal 
of OE and is reflected by various programs w*thln the agency. 
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E. PRESENT OPERATIONS OF THE D&U UNIT 



1. ^ Staff 

At the time of interviewing, the staff of NCEC included twenty- 
eight professionals and twelve clerical persons. The number of staff is 
controlled both by the Salary and Expense budget and the number of slots 
available, with the latter factor being the primary determinant. Staff 
members include people with bacl<grounds In local information centers, teaching, 
computer and information science woric, and school administration. 

2. Funding Base 

The NCEC budget has been allocated as the dissemination line of 
the RSD budget of OE. Before f^Y 1970, ERIC had about $5 million annually. 
Since theri, funds have been appropriated for both ERIC and other objectives, 
e.g., installation efforts. The total funding base for FY 1973» as passed 
in the Appropriations Bill, is $14,750 million, with about $9 million allocated 
for the extension program and the remaining funds for the communication support 
program. 

3. Fun ct ions \ 

NCEC staff activities vary according to the particular unit within 
which staff members worl<. In the Division of Educational Extension Syrtems, 
staff members of the Extension Support Branch sponsor much of the RSD work 
in the area of D&U and also the evaluations done of NCEC itself. In the 
Division of Communication Support, there is an ERIC staff which primarily 
monitors the Clearinghouses and supporting contracts, and an Educational Refer- 
ence Center (ERC) staff which provides direct information services and performs 
such tasl<s as computer searches requested by OE and HEW staff. 



F. OTHER DSU EFFORTS 

Although specific D&U activities still occur in some other parts of OE, 
NCEC increasingly has been viewed as the center for such activities whereby 
various programs and efforts can be linked to educators in the field. However, 
\'arious other OE programs continue to support their own dissemination efforts 
and, in some cases, specific legislative authorization requires that programs 
include built-in dissemination (e.g., projects supported by Title III and 
Title I of ESEA). 

Various library units and reference units have been set up in OE, and 
the Regional Laboratories and university-based R&D Centers have developed 
dissemination mechanisms of their own which are available to NCEC staff. In 
the Bureau of Adult Vocational and Technical Education, "satellite*' centers 
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have been set up in some states for dissemination purposes and some^of the 
Research Coordinating Units also conduct <jisseminat ion activities. The 
Bureau of Elementary and Secondary Education (BESE) attempts to bring the 
potential adopter-adapter of an ' i nnovat ion and the producer of the innovation 
together; one method tSey are using to implement this model is an Education 
Innovation Fair, Within BESE, the Division of Planned Supplementary Centers 
administers^ the Title III funds; this program funds resource centers organized 
within each state and is the one program that has dissemination built into 
it by law. 

A1 j OE publications intended for general distribution ^^^re cleared for 
style and policy through the Off fee of Public Affairs (OPA) . OPA handles 
the public relations activities of OE ranging from press releases and coverage 
to National Education Televisiop programs and radio tapes. Although most of 
OPA's activities are intended for the general public, articles also are placed 
in specific educational Journals to reach a more defined audience. 



G. THE KNOWLEDGE BAS^ 

Approximately one-third of the current effort among Clearinghouses and 
contractors is geared to the production of reviews, syntheses, etc., drawing 
upon the total knowledge base in educaticri. These products are also processed 
by NCEC: they are disseminated both, within^ the ERIC system and directly to 
policy malcers, practitioners, and to ^some extent, the research community. 
Many of the repackaged products have originated in projects of the Dissemination 
Programs Branch of NCpC. This Branch sponsors PfEP reports which provide 
interpretive information for practitioners and policy makers In addition to 
sy^theses^ and' reviews. The Exemplary Programs and Practices service has also 
been developed in an at.tempt to 1 dent i fy , va 1 idate, facilitate, and promote the 
adoption of the most effective new programs or products, * Efforts to try to 
break the knowledge base loode from simply technical reports to look at other 
kinds of knowledge, programs, practices, and products were felt to be a part 
o^ the NCEC knowledge base by staff members. Such efforts include the collection 
of promising practices, on-line batch searching, and RsD installation efforts 
(e.g., Toy Lending Library). These materials then become the object of NCEC 

oeu activities. ; 

NCEC has also sponsored a number of studies to;'understand .and guide ^ 
their own D&U activities* These studies range from contracts for large liter- 
ature reviews and conceptualizations in the field of D6U theory to specific 
evaluations of the impact of a particular delivery format. Some examples 
suggest the broad rnnge of these efforts: 

The exh&>ustive literature review and theory development 
container} in the report. PLANNING FOR INNOVATION" (Havelock, 
R.G., Center fpr Research on Uti 1 ization- of Scientific 
Knowledge/ Institute for Social- Research, ^Ann Arbor, Mich.). 



A Study of innovative behavior among school superintendents, 

A study of the file structure of ERIC, with an eye toward 
partitioning the data base to better fit the cognitive and 
terminological sets of practitioners. 

Studies of the functions and roles of the overall ERIC system. 

Several evaluation studies, e.g.: Clearinghouse products. 
Educational Product Displays, etc. 

Studies of the information needs of a var^iity of typical 
educat ional users . 



H. AUDIENCES 



1 • Intended CI ients 



Interviews with NCEC staff provided the following breakdown of the 
intended clients for the work the Center does: 



1. Educational decision makers at the state and local level, 
extending down to the individual teacher. 

2. ''Consumers*' or clients of education, including school boards, 
community groups, parents, etc. 

3. Federal decision makers; subdivlde/j into OE staff and Congress. 

4. The R&D community, including researchers both In D&U and in 
basic educational research » development projects, and evaluation 
work. 

2. Actual CI ients 



a. Pol i cy Makers 

' In general, most of the contacts that NCEC has with non-OE policy 
makers* at the Federal .evet come through information requests that are typically 
seat to the Educational Reference Center (ERC) and answered cut of ERIC data 
base searches. Persona) contacts with Congress are limited by policy (as in 
most »>deral agencies), except as instigated by the legislative branch. 

Within OE a mixture of formal (ERC) and informal means arc used to 
reach policy makers. Infernal contacts and a policy of distributing new 
products tp OE policy makers both serve to keep these staff members aware of 
NCEC activities and help to build a general concern for D&U. 
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b. Practitioners 

Practitioners are the gre^ttest audience of NCEC's work; the most 
important groups are the local leve! decision makers, e.g.» superintendents, 
school boards, state level education staff. NCEC*s direct contacts with 
practitioners come primarily via the various print materials It prepares and 
processes such as model program awareness documents, products of the Targe tted 
Communication program, and PREP materials, and indirectly through the Clearing- 
houses, the ERIC data base, and the demonstration project program. Informal 
contacts exist on a more limited basis because of the small size of NCEC as 
compared to the potential practitioner population; however, staff try to 
contact state education heads whenever possible. Regular meetings held with 
dissemination representatives from the SO states and convention booths and 
displays (handled by the Clearinghouses) are also used. 

A new thrust will be the extension agent, a role being created to fill 
the Interpersonal linkage semi-vacuum at the state level. Coupled with the 
growth of local or state level information centers, the extension agent will 
be able to interface between retrievable R&D information and the specific 
needs of individual practitioners. Information centers will also be publicized 
for direct use by practitioners. 

c. OE Staff 

Linkages to OE staff, e.g., programs or bureaus, roughly parallel 
those to OE policy makers, but the process of shared proposal review and 
critique also forms a bridge. There is also informal collaboration In 
identifying products to receive dissemination efforts. 

d. Researchers 

Host of the formal information flow between NCEC and researchers 
is through the RFP proposal interchange. In addition, ERIC has become known 
as a centralized repository for educational research information, and as such, 
is being utilized by researchers tor literature reviews. The ERIC centers 
also link to 283 professional associations to publicize the ERIC data base 
and services. 

e. Consumers and the General Public 

There has been little direct contact with this audience, again 
chiefly because of the size of this population and the existence of other 
pressing priorities for NCEC. Undoubtedly, however, the new information 
centers and extension agents will have a somewhat higher profile for this 
coniumer group. 
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CHAPTER I I I 



THE MODEL OF PROBLEM-SOLVI KG LINKAGE: 
AN OVERVIEW AND RATIONALE FOR THE ANALYTICAL 
FRAMEWORK USED TO COMPARE DtU AGENCY FUNCTIONS 



I . BACKGROUND AND RATIONALE 

A. CONTEXT: WHY IS RESEARCH UTILIZATION AN ISSUE? 

In the largest view a federal agency in a human service area is a 
national problem solver for the people as a whole, with a special focus 
on the problems and needs of people within its service domain. Congres- 
sional legislation usually confines the mission at any one point in time 
to certain types of services for certain types of users, but since the 
legislator's knowledge of what represents effective "'service** is still 
very cloudy in most areas, the legislative mandate has increasingly in- 
cluded ''research** or *'R&D'** as an Important category of activity. 

The original rationale for federal support of research on human ser- 
vices was probably somewhat obscure. It appeared that earlier investments 
in medical research had led to improved health practices and that some 
really very basic research in physics had led to the atomic bomb. Hence, 
Congress had become accustomed to providing regular support for hard 
science almost carte blanche with tha scientists themselves making the key 
decisions on objectives and criteria of worth. The apparently visible 
fact that research had been used successfully over and over again to im- 
prove practice In medicine, agriculture, and industry was enough evidence 
to the legislators that research investments paid off; however, the actual 
patterns and paths toward application and utilization were rarely analyzed 
and only obscurely understood. When the federal government began In the 
1950*s and early I960*s to support **soft" science in significant amounts, 
a similar carte blanche philosophy prevailed. Grants were provided to 
researchers In universities to Pursue their own interests within a broad 
domain of "relevance.** But the **soft** sciences generally never had the 
trust and respect afforded the **hara** sciences so that the question of 
utility was raised early and loudly in many quarters before a broad know- 
ledge base could be developed and before academic social scientists could 
mobilize an effective network (and lobby) of their own. 

This discontent with social research is expressed in many guises. 
Sometimes it Is a call for different types of research, e.g,, more *'relevant** 
research or more applied research. Sometimes it is a call for **hi^her 
quality*' of research and of researchers in a given area or more effective 
planning and coordination of research efforts (which the universities 
typically can't cope with). The problem is also sometimes cast in communi- 
cation terms, e.g., the need for more forceful or extensive diffusion ofv 



*RSD " Research and Development; D&U " Dissemination and Utilization. 
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research findings to policy makers, the public, practitioners, or whoever, 
and more effective translation of research so that non- researchers (at 
various levels of power) can make sense of it. These are some of the man> 
voices of concern that are forcing us to look at the problem of research 
utilization more seriously. 

B. THE PROBLEM-SOLVING DIALOGUE 

It is more than likely that most of these separate views about what 
is wrong with R&D are correct, but to hear them all together makes for 
confusing listening. This is why we feel it is essential tooconstruct a 
model which is simple, broadly applicable and logical. We propose that 
the two component problem-solving dialogue serves reasonably well as such 
a model. The figure below depicts this model in its most rudimentary form* 

FIGURE 3.1 The Problem-Solving Dialogue 




The "user " {>)# Is some person or group (of any size or complexity) 
which requires something from outside itself. In order to acquire this 
needed Item it reaches out into the environment (2), to find some person 
or group or location where the item might exist (3)» If the item does in 
fact exist or If it can be created, then it has to be transmitted or trans- 
ported back to the user (A). This model generally describes the relation- 
ship between federal service-providing agencies and their clients, the 
people. As our society has developed, its citizens have been able to 
differentiate and articulate more and more need areas where they want to 
receive **he1p/* For some of these need areas the private sector has been 
an adequate provider but for some it has not, so that Increasingly govern- 
ment agencies have become helpers across the widest span of human needs. To 
meet the demand, most often expressed through political and legislation 
action, the government has set up specialized agencies and bureaus which act 
as 'Vesourcers'* for the particular need area designated. Hence, a kind of 
gigantic 2-way problem-solving dialogue begins to take place between these 
new agencies and the segments of the society which feel the need most acute- 
ly* Figure suggests how this dialogue begins to take shape. However, 
anyone who has observed the evolution of our society will be acutely aware 
that it is hardly ever that simple. Chief among the complexities is the 
fact that the federal agency does not usually know what to do or how to do 
It. The citizens say *'cure cancer, eliminate poverty, teach everybody to 
read, rehabilitate all the handicapped, give everyone a Job.** No government 
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FIGURE 3.2 



How a Societal Problem-Solving Dialogue Might Get Started 
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agency in itself has the knowledge to do any of these things, and as a 
result they have sometimes turned to knowledge building specialists (i.e., 
the R&D community) to provide them with some of the answers. As a result, 
a second type of 2*way problem-solving dialogue comes into being in which 
the federal agency is the needy client and the R&D community Is the 
resource r. 

In addition and at a much broader and looser level the R&D community 
carries on a di rect dialogue with the society as a whole, i.e., to some 
degree researchers are !.ensitive to current social needs, want to work in 
those areas, and are encouraged to do so by the foundations, Industries, 
and citizens who provide their financial support. In turn, the R&D 

[Insert Figure 3*3 here] 

community disseminates the results of its work widely through all manner 
of specialized and mass media. To some degree this dialogue will take 
place with or without the intervention of a central government although 
Increasingly the government has become not only a prime supporter but both 
a middle man and a prime consumer for R&D in all fields. Indeed, as 
suggested by F^lgure 3.^, the relationship among these three entities can 

[Insert Figure 3.*'» here) 

be seen as consisting of over-lapping two component problem-solving dia4ogues. 
The people depend on the government as a resourcer to fulfill various needs; 
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FIGURE 3.3 
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the government as user, depends in turn ort the RSD community as resourcer; 
and finally the people collectively depend on the RSD community directly 
as resourcer. Figure 3<4 also suggests a crucial point of emphasis in our 
research; we want to view federal agencies as mediatora of exchange In a 
macrosystem of helping and problem*sol ving. We are not sure that most 
federal agencies now ^ee themselves this way, but we feel that it Is one 
possible model which points out (a) the function of federally supported RSD, 
and (b) the essential elements In th^ process of making R&D pay off for 
society. 
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Three Essential Aspects of the Problem-Solving Dialogue: 
(1) System Building, (2) Transmission, and (3) Transformation 
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A system is a set of interdependent and interacting elements which go 
together to serve a common purpose. Therefore, the necessary conditions for 
the existence of a system are (a) the separate elements (subsystems, personnel, 
resources, roles, etc.) required to fulfill the system's mission; and (b) 
communication and coordination among the elements. Figure 3<5 suggests what 
is needed for a problem-solving dialogue system. First of all, there must 
be a user (1), and a resourcer (S) , and there must be a means of 2-way 
dialogue between them (3) and (4^. The two elements (there could, of course, 
be many elements) plus the flow between them equals the system (3) « But 
when we look closer and v^e ask how the messages are created, sent, and 
received, we find that the dynamics of the system can be summarized In terms 
of two processes: transmissions and transformations. 

Starting with the user's need, the first task Is to trans fom need into 
an expression or articulated message of need . Subsequently, this message 
must be transmitted to resourcerrTuT"! Then the need must be received and 
transformed by the resourcepS into researchable questions , solvable problems 
or diagnostic statements . These statements, In turn, must be processed and. 
In effect, transformed into solut ion i deas , relevant answers , or potentially 
usable facts and artifacts . The solution outputs then must be transmitted 
back to the user {k) and finally they must be transformed again by the user 
into actual solutions or need reductions through his testing, consumption, or 
integration efforts. Thus, a microanalysis of a working system will always 
reveal a continuing sequence of transforming and transmitting. 

There is no way to present a satisfactory picture of the complex know- 
ledge flow systems which serve the various need sectors of our society. 
Figure 3.6 may suggest why this Is so. Consider each of the arrows in this 
figure as one type of transmission and the spaces between arrows as trans- 
formations. Noto that many arrows simultaneously go in both directions, 
iridicatlve of the multiple-channel, multl-medSa (especially person-to- 
person and person- to-pri nt) , and pervasively redundant nature of communication 
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about national problem-solving. Note also that different arrows originate 
at different points in the resource system and impact at different points in 
the user system and vice versa. Hence, effective transfer and problem- 
solving will depend on the amount of social integration and communication 



FIGURE 3*6 




ERIC 



within each system. Note thirdly that different arrows are of greatly 
differing lengths: some stretch all the way from one subsystem to the 
other, suggestive of the kinds of communications that can take place when 
scientists talk directly to policy makers and to the general pubjic through 
popular media. Others are short and stubby* suggesting (a) the need for 
multiple linkage points along the way and (b) the fact that detailed and 
complex knowledge loads can usually be carried only by very specialized 
media which have specialised audiences. Fourthly , It should be noted that 
many arrows curl Into the figure to form closed loops without spanning the 
whole distance from resource system to user system. In fact, effective 
transfer of knowledge to outsiders usually requires much internal dialogue 
among both research persons and users and» Indeed, such problem-solving 
loops must also occur all the way along the knowledge flow chain. Finally, 
note the arrows entering and leaving the figure suggesting the inherently 
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open-system nature of knowledge flow in a large and sophisticated society. 
Some important inputs arrive Sisrendipltously from both random and planned 
Interactions wfth other systems and wfth the environment. 

In spite of this comolaxlty, we believe that societal knowledge flow 
processes can be studied systematically and subjected to a meaningful 
analysis whfch is reasonably comprehensive. Such analysis and study can 
provide federal agencies with clearer images of their own role in the larger 
system and can steer them toward a coherent set of objectives for improving 
national problem- solving and improving the utilization of federally -sponsored 
R&D. 

I I . THE FRAMEWORK 
A. OVERVIEW 

As a first step toward this kind of analysis we propose an elaboration 
of Figure 3-1 which can account for some of the complexity of Figure 3.6 in 
a functional schema. Figure 3»7 suggests six major groupings of functions 
that are necessary if the R6D community and the client groups in one need 
domain are to work together as one problem-solving system. The figure can be 
read clockwise starting with the user (1) as the one who has the need and 
feels the '*pain'* proceeding through the articulation and communication of 
that need (2) to resource systems to the generation of solutions and the 
transmittal of those solutions (4) back to users. Not be be neglected^ 



FIGURE 3.7 



An Elaborated Framework for Analyses 



Mac rosyi tern 
6u M d tnq 



however, are functions we describe as "system building," the micro-level 
(5) these activities consist of bringing together subgroup^ of resource 
persons to work on specific user problems at clo^e range with genuine and 
immediate dialogue. At the macro-level system biullding functions include 
creating broad awareness of common concern, establishing special linking 
subsystems and Improving the operations cf all elements through system- 
wide governance. In the next few pages we will explain some of the specific 
activities which should go on within each of these six groupings. 

B. THE SIX COMPONENTS 

1 . User Self-Servicing 

Problem-solving systems should exist primarily to serve th^ needs 
of consumer- users. Hence, If the user serves himsel f wi thout help or 
if a good Job Is done by those who provide direct services, the rest 
of the '^system'* Is superfluous. Indeed there is a tendency among 
direct service providers to think that all effort and concern should 
be concentrated here on direct service (e.g., ''jus't leave us alone and 
we can do It ourselves" or "Just give us the money ^d stop harassing"). 
The federal analogy Is the federal agency with a sharply defined and 
routlnized mission, little or no research budget, and no Interest In 
experimentation. 



FIGURE 3.8 User Self-Servicing Function 
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We would propose, however, (see Figure 3,8) that an effective and 
progressive user servicing subsystem has a good localized problem*- 
solving capability, (Kl), maintains a continuing awareness of its 
needs, present and future, (1.2), knows how to express its needs to 
potential resource persons and groups, (1.3) t looks outward for innova- 
tions, (1.4), and is able to adapt new ideas from outside, (1.5). 

A federal agency which was very "user-oriented" in its philosophy 
might focus its attention on helping the user help himself by providing 
training or support on any of the above subprocesses . 

2. Need Process i ng 

/ 

FIGURE 3«9 Need Processing Functions 




V "Need processing" denotes the various activities required to 

communicate user needs to resource persons and systems. It is often 
seen as a political process because in a democracy the public fs 
pr^lTumably able to choose leaders and policies which will work for 
them 3nd help them by solving problems according to the needs wnich 
are deemed "priority" at a given point in time. Yet need processing 
Is, in fact, an extremely complicated function which can be analyzed 
Into several subprocesses, some of which are represented in Figure 3.9« 



The most political and controversial of these need processing 
activities is ''need arousaV (2.1). It Is a fact that most users 
most of the time are cither fgnorant of their most important needs 
or complacent about them. Therefore, the aw<:ikening of needs can be 
seen as a necessary first step in the cycle of problem-solving and 
may involve a range of tactics from benign questioning and gentle 
moralizing to leading national crusades. 

•'Need sensing" (2.2) denotes helping a client to find or 
recognize needs that are already present but not clearly in focut>. 
In contrast to "need arousal," need sensing leaves the user alone. 
It m<iy come in the form of sampling opinion or "testing the vdter's 
pulse." Such Sensing may not go very far In defining what is really 
wrong but a good need sensor might .know that something is wrong, e.g., 
that the peopie are frustrated and angry. 

, "Need definition" (2.3) is another important potential helping 
function which includes need clarification, differentiation, labelling, 
and; class i fying. With respect to this function It is important to not*, 
that definitions of need do not and should, not stay put over time. 
Mar^y of today's social ills were once defined as moral ones with respon- 
sibility and blame often assigned to the victims as "sinners." Re* 
def^inition of these samfi ills as social or economic problems has often 
pointed the way to new types of solutions and solution building processes 

Ignorance, poverty, alcoholism, mental illness and hig hway dea th or 

injury are just a few of the areas where a redef ini tTonal process has 
le'd to new solution building activities. 

I The task of quantitative needs assessment (2.4) has been routinely 
carried out since World War II in a few areas on a limited number of 
'Simple dimensions (such as the unemployment index). Some policy makers 
have become increasingly aware of the value of such measures and the 
need for accurate, detailed, and frequent monitoring of public needs 
on a variety of "social indicators." Such data would presumably be 
ths raw material for new policies and new guidance for R6D efforts. 

j Information on needs has several potential audiences, one of which^ 
IS, the people themselves for whom such Information serves as "need 
arousal" (2.1) and "sensing" (2.2). From a national problem*$ol ving 
perspective, however, there are two other crucial audienr.es, the policy 
ma<ers (2.5) and the re1eve>nt RSP communfties (2.6), For proper trans-^ 
mi ssion to these aud iences, need data must be collated and inserted 
regularly In popular and specialized media. / 

Moving to the resourcer end of Figure 3*9» we can discern some 
additional specialized transformation activities; an esse^ntial activity 
for policy makers is the translation of need priorities ^nto programs 
and program priorities with specific expenditure author i^zat ions attached 
to| them (2.7)- There is hardly any more important "message" for the 
Rsp community to receive. 



Finally, it fs v:5Mally the researchers, themselves, who must 
make the final "transformation" of needs into problem statements and 
researchable questions (2,8) . These in turn become the objectives 
and hypotheses of subsequent RSD projects • 

3. ' Solution Bui Iding 

Solution building Is not the exclusive function of any one subgroup; 
it is a process in which all kinds of oersons and groups, including users, 
can and must partiiclpate to some exl^.i^ Nevertheless, the society does 
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turn to researchers, developers, technologists and scholars for help 
on the many problemt: for which self-servicing is inadequate. For 
simplicity of^ prescntat Ion we group these together as the "R&D coiimuni ty ." 
"Science," per se. Is usually defined as a procedure for the discovery 
jnd verification of knowledge about natural phenomena in general. 

i 
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The more recently introduced concept of "R&D" shifts the emphasis from 
valid knowledge building to the building of knowledge-based products 
and procedures which have been "validated" in terms of utility to 
people in fulfilling needs. Although this is not the place to review 
in any detail the various subprocesses that can be included in "R&D," 
some are suggested in Figure 3'10. 

"Solution building" as conceived here encompasses basic research 
on hum.aivlbehavior and society, basic and applied diagnostic and 
^descriptive research on relevant populations and their needs, invention 
and experimentation with solution ideas or ivinovations that might be 
relevant to solutions, and evaluation of potential solutions. It 
would also include theoretical and methodological studies. Among these 
•various bits and pieces we would expect to see numerous transformations, 
transmissions, fusions, and interactions as necessary precursors to 
the ultimate production of valid and workable solutions and solution 
ideas . 

In Figure 3.10, three processes have been singled out for special 
mention in the context of knowledge flow in a national problem-solving 
system* 

Function 3*1 "relevance pressure" is increasingly evident rn all 
fields of science but especially the social sciences. Some of this 
pressure comes from outside the scientific community in the fo.m of 
federal grant programs constraints, directives, etc. (see again function 
set #2) but much of it is generated within the scientific community it- 
self. Traditionally scientists in justifying their work have only had 
to answer the question "What does it contribute to knowledge." Today 
they must also answer the question "What does it contribute to society." 

Function 3-2 "pressure toward utilization" is also gradually be- 
coming a fact of life for the scientific community. No longer is it 
enough to publish in a scholarly journal (with one's scientific 
colleagues as the sole audience). New the scientist is asked or moti- 
vated to publish more popular versions of his work, to consult with 
government policy makers, to feed back results to- respondents, to put 
on demonstrations and conduct conferences at which practitioners and 
policy makers are an important part of "the audience. 

Still least recognized and understood is the important area of 
research which concerns itself directly with knowledge flow and utiliza- 
tion processes. (Function 3-3 'n Figure 3.10). The empirical basis for 
designing and improving national problem-solving is today woefully 
weak. Yet at some point in the not-too-distant future, we expect that 
the study of the utilization of science will come to be seen as one of 
the most Important specialties in the R6D community. 

Solution Processing 

"Solution processing" consists of the many steps of transformation 
and transmission required to move a valid solution idea into Implementa- 
tion in a user system. 
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A solution processing agency must have three overriding concerns: 
firsts to transform R&D knowledge so as to maximize its value to the 
various audiences defined as "relevant"; second, to transmit this know- 
ledge to and through the social system so as to reach the largest number 
of persons within these relevant audiences; and third, to insure that 
such transformation and transmission be to the self-perceived benefit 
of these audiences and the people served by the agency. Put more 
succinctly, the agency must transform knowledge, transmit knowledge, 
and help people to use the knowledge. It must perform all these acti- 
vities more or less concurrently and in a coordinated fashion so that 
the transformations are indeed helpful and useful to people, and so 
that they are transmitted to the people on the right channel, in the 
right way, and at the right time. 



It may be useful to imagine a hypothetical utilization agency which 
performs all three functions to the maximum degree. Such an agency would, 
of course, have a vast storehouse of solid, valid, and relevant research 
knowledge to draw upon. It would also have defined Its audiences and 
most likely divided them into at least four sub-audiences: the policy 
makers, the operational professionals in the need system served by the 
agency, the concerned clients of the service, and the researcher community. 
The transmitting mechanisms (A. 2) would allow any relevant piece of research 
knowledge to reach any person in any of these sub-audiences who needed it. 
The transformation mechanisms (^.1) would insure that such research know- 
ledge arrives at the user's doorstep in the form in which he can under- 
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Stand, accept, and use it. This probably means that there must be at 
least four types of transformations: (a) for policy makers; (b) for 
pract i t i oner-profess i ona J s ; (c) for consumers ; and (d) for re- 
searchers. 

Finally, and most importantly, in order to fulfill its helping 
function ('♦•S)! this maximal agency would be able to work in a con- 
tinuing context of users' needs such that (a) the short and long term 
needs of the greater social system would be served; (b) the needs of 
the agency's clients would be served; and (c) the specific needs of 
policy makers, practitioners, and researchers within that larger need context 
would be served, also. The communication of need and the development 
of a shared awareriess and consensus on need throughout the system 
(Function Set #2 discussed previously), are also crucially important to 
the helping function. However, there ar^e additional considerations; 
for example, the maximal utilization agency must be aware of users' 
internal problem-solving processes (l,l) and must develop mechanisms 
of continuing dialogue between users and knowledge source&,on both 
needs and solutions, 

5. Microsystem Building 

Figure 3-9 and Figure 3.11 suggest an elaborate division of labor 
and an extended chain of influence which is essentially linear in de- 
tail. There is a danger in such a detailed linear analysis of losing 
sight of the interdependence and systemic relatedness of these elements. 
There is also a danger that individual role holders in this elaborate 
chain will lose sight of chc two-way dialogue which must underlie 
successful communication. For these reasons a sophisticated knowledge 
Flow system will include some activities in which many elements of the 
probl em^sol vi ny dialogue are simultaneously present and are allowed 
to interact on a small scale. We use the term "microsystem building^* 
as a general heading to cover these activities. Their general nature 
and purpose are suggested by Figure 3-12, 

[Insert Figure 3.12 here] 

The most elementary form of microsystem building involves bringing 
together researchers (or developers) with representative users for 
purposes of dialogue about needs and solutions. These interchanges (5-1) 
should produce two-way Influence to make researchers more attuned to 
user needs and more concerned about generating useful products while at 
the same time users are becoming more aware of the research process and 
the value of research f^^dings. 

'*User-co1 laboratl ve RSD" (5*2) Is a somewhat more elaborate and 
organized form of microsystem building which puts researchers and users 
together In the same projects (sometimes called "experiments" or 
"demonstration projects"; where both research and use are supposed to 
take place cpncurrently , ' To some extent users in this situation learn 
to be "researchers" while researchers "get their hands dirty" by serio'us 
involvement in user problem situations; there is strong pressure t^\ 
deliver meaningful help to *'he user from the activity regardless of th^ 
research object! ves of the enterprise. \^ 
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The most elaborate and extended types of activity which fall 
within this category could be called "integrated RDD6U programs." 
These are activities which may include large numbers of users, 
practitioners, and researchers and possibly a number of projects 
spaced out over time. What makes them ''^microsysterrts" Is the fact 
that they are planned and coord i natqji very explicitly around some 
specific goals related to user needs and are expected to be 
accomplished within a given time frame. These microsystems may 
contain On a small scale most of the elements that are needed in 
the society at large to undertake national problem-solving (i.e., 
those sets of functions identified in the outer rim of Figure 3.7). 
Hence, they can serve as kinds of "laboratories" or "hot houses" 
in which the larger network of relationships and functions can be 
modelled (see dotted arrows of Figure 3«12). 
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Microsystem building has several potential uses for the macro- 
system in addition to the "modelling" function just mentioned. 
First of all, it builds awareness and openness of researchers to 
users and vice versa. It also leads to specific linkages between 
a (usually small) subset of users and researchers. If these users 
and researchers are strategically located and represent leadership 
in their respective reference groups, then the linkages so established 
can be said to form a genuine bridge between R&D communities and 
user populations, a bridge on which both need messages j[Function Set 
#2) and solution messages (Function Set #A) can travel freely. 
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Microsystems also can plan an important role in both' solution 
building (#3) and user servicing (#1). When microsystem activities 
are well defined, well organ] zed, and we]l evaluated, they can 
contribute meaningfully to general knowledge about the problem area 
and about solution alternatives. This is often implied In the 
labelling of these activities as "experiments "pilot programs," 
or "demonstrations." Expectations in this regard are more likely 
to be realized if the research collaborators have good track records 
and have the major say tn what happens. On the other hand, micro- 
systems can also serve as models of good user self-servicing (Function 
Set #1) particularly if the users are able to be true collaborators, 
have major decision making power in the program, and use that. power 
to improve their long term self-service capacity, 

"6. Macrosystem Building 

The role of governnf>ent In the U.S. is generally not to do research 
or service di rectly but to hover over the complex of institutional 
forms which provide service and perform social problem-solving, 
attempting to serve and represent the general public and the general 
good by "coordinating" separate efforts. Government should see to 
it that RSD communities arid service professions work together with 
users so that they collectively function as a problem-solving system 
to the benefit of the' society. 

The agencies of government can work to shape and reshape the 
macrosystem in various ways, e.g., through exerting direct control 
on certain individuals and subsystems via legal sanctions, rules and 
regulations, through protection of other Individuals and subsystems, 
through tinancial support "and -Subsidy df~various subsystems, and 
through the creation of new roles, institutions, and other facilita- 
ting mechansims to fill recognized gaps and to help the total system 
function more effectively and beneficially. 

No one unit within a large federal agency will have responsibility 
for all these functions but each can contribute in a major way to the 
government's ability to function as a problem-solving facilitator. 
First of all, every sub-agency should have a coherent and consensual 
Image of the evolving macrosystem so that gaps and points of need can 
be identified and monitored. We might call this "macrosystem mapping 
and modelling" (6.,1). 

Figure 3-13 suggests some of the so^iial structural elements that 
might go into a mapping of a problem-solving macrosystem. The complexity 
of the system as suggested by* the figure is truly awesome, but several 

[Insert Figure 3*13 here] 

major interfaces can be noted, e.g., consumer-to-servJce professions, 
consumer- to- i ndustry , i ndus t ry-to-uni vers i ty , uni vers i ty- to- government , 
and so on. At each major Interface effective linkage (2-way communica- 
tion on needs and solutipns) is vital. We should also note from this 
figure and our earlier discussion that there must.be a continuous chain 



of communication links so that the complex of real' organi zations and 
overlapping groupings represented in Figure 3 . 1 3 can» f unctTbn^ 1 i ke 
the ideal problem-solving system represented in Figure 3*7- 

It should^be born Ih mind that no one agency, government or other^ 
wise, performs or controls the performance of all the functions of 
social problem-sol vi'^g. Yet government can and does play several 
important roles wit'iin It, first of all by representing the consumer 
and the consumer's interest, by coordinating, monitoring and regulating 
private sector subsys terns ; .by supporting most research and development, 
aad by filling gaps in the system by (a) providing direct government 
services' when needed and (b) by establishing new elements* through con- 
tracts, matching funds, expansion grants, and so forth. 

System modelling and mapping are activities ,that no one unit 
should perform exclusively without collaboration with other parts of 
the federal agency, especial ly top policy and planning personnel . 
Strategically located private sector decision makers,- observers, and 
scholars also need to be Involved. However, several key functions In 
system modelling can be played by specialized units through providing 
information to help in defining and delineating the system and Its 
elements (the relevant user population, professions, reference groups, 
R&D communist ies , etc.). Some unit should also be charged with the 
responsibility of monitoring the macrosystem (6.2), i .e. funnel 1 Ing 
the streams of '"social indicator'* data which assess the current health 
of the system and the changing needs and problems of users. 

There may also be a need fo.r a specialized unit to be a promoter 
of linkage (6.3) generally within the macrosystem (researchers4i^developers 
OPXQct i t ionersOpol i cy makers4-#consumer$ , etc.) and between macrosyst^ms 
in different need areas (educationf^manpowerf-^health, etc.). Linkage 
can be promoted through bringing people together in face-to-face meetings, 
conferences, workshops, etc., through developing new types of media, and 
through increasing all types of message flow. 

Another important macrosystem function Involves f i 1 ling recognized 
gaps (6.^) with new roles or organizational forms. Special types of 
libraries, information centers, research utilization spectaUsts, 
.linker roles, *'think tanks," "ut 1 1 1 zat Ion .tanks or whatever may need 
to be created, Eaph such new institutional form represents an alter- 
ation of the structure of the macrosystem and should be justified on the 
basis of its fit v;ith the emerging macro-model of national problem-solving. 

A final function related to macrosystem building is the creation of 
awareness by system members of themselves as part of a system (6.5)* 
This function is particularly important for areas which are emerging as 
problem foci and where no one discipline of science or practice adequately 
encompasses the need domain.* Also when a macrosystem is shifting its 



*The Social and Rehabilitation Service represents an outs tand Ing exampl e in 
thrs regard. 



emphasis or its definition of "useri^," '^clients," etc., it may need 
to communicate this shift widely to all who may be- a part of the system. 
Awareness building is usually done more. efficiently through mass media 
and through the evocations of highly visible and stratecflcally located 
op.lnion leaders, 

III. ^ APPLICATIONS AND QUALIFICATIONS 

In the chapter which follows, we will apply the model described above 
to the detailed workings of each of the four agencies in our study. We 
believe that the model has been very successful as a means of categorizing, 
interrelat ing, and comparing as great number of seemingly disparate DSD acti- 
vities regardless of the particular DSU system. On the other hand, we should 
be careful not to apply the model with a heavy hand without due regard to a 
few subtleties and qualifications, I'h this last section of this chapter, 
we will discuss a few of these in the hope that they will provide a more 
sophisticated view of the problem, 

A, HOW MACRO CAN YOU GET? ^ ^ 

The limits of any' "system" are arbitrary from a strictly analytical point 
of view, A system may include as many or as few persons, groups, or elements 
as the analyst wishes to identify, Likewls?., resourcer-user problem-solving 
systems may include any designated set of resource persons and resources, 
any set of users, and any set of user needs. 

Yet in using a systems model as a means of analysis, monitoring, and 
governance, a course which we are suggesting for DSU, the limits of the 
system in all these regards must be set in some way. Hence, we need to de- 
fine the body of RSD which constitutes the basis of system "messages" from 
resourcers to users, the ne^d domains within which relevant need "messages" 
ought to be flowing from users to resourcers^ and the various persons and 
groups which constitute the resourcers, users, and message mediators at various 
points in between. 

The agencies we have studied in this project have some trouble defining 
the linits of their "systems," and if we examine Figure 3*1^, perhaps we can 
understand why. This figure is drawn to suggest the relative position of 
the D&U unit within a universe of resource Systems, users, policy makers, 
administrative hierarchies, service organizations, mediators, etc. Only a 
few of the connections are indicated and the figure is drawn primarily to 
show (a) the relative distance and position of the D&U unit with respect to 
major groups in its environment and (b) the most significant interfaces at v4iich 
the unit must operate. 

The figure should show the vastness and complexity of the "systems" we 
are talking about' in spite of the fact that it is grossly oversimplified. 
Very loosely speaking, the left hand side of the figure depicts 'resource" 
groups, the center depicts mediating groups, and the right hand side depicts 
users, 

• * 
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The outer edges of the figure represent /'important DSU transactions over 
which the DSU unit is Hkely to have no tontrol or influence whatever. These 
include \T} the subtle but pervasive influences of pubCNc needs and ' des i res , " 
and social trends on 'the acadfemic community as a whole and on would-be problem 
solvers and resource persons at all levels. Sometime^s these i nf 1 uences . are 
exerted tTirough the mass media. 

A second set of transactions over which little control is likely to be 



exerted by the D&U unit involves policy advice and guidance [2j provided to 
the highest levels of the national government by prestigious academics and 
scientists in various specialties. The influence of academia in this regard 
hasi genera 1 ly been increasi,pg in' the last two decades and is most evident in 
the council of economic advisors and in the appointrpent of university professors 
• to high government posts.." 

The D&U unit alsb has virtually nothing to do with the communication of 
needs from user interest groups and tlrg public at large [T] to the highest 
levels of government or to state and local government. Such transactions 
occur mostly through traditional political processes reinforced by the mass 
media. 

While these three forces are peripheral to D6U agency concerns, they 
form the environment within which \i\t operates. Therefore, the unit must 
be sensitive and alert to what is going on- in each aro,a. 

The heavy circle in the figure encloses the subgroups which have the 
most operational contact with and control over the DsU unit. Relations with 
any of these groups could represent a target for improved linkage, and in 
j our interviews we found that various gntts had worked with ecich. 

\ 

^ The relative position and power of the D^U unit within this sphere of 
influence wf 1 1 change from time to time and can be deliberately shifted up, 
down, in, or out, by the policy makers and, to some extent, congressional 
action. As we have seen in Chapter Two, there has been a fairly steady trend 
of DSU, first Into separate visibility within the R&D sub-agency, then in 
some cases, elevation from branch to division, then in some cases (NCEC) to 
equal organizational status with R&O. * . 

The figure also illustrates the extreme distance in organizational terms 
between the D&U unit and. the ultimate user. In fact, "users** are typically 
state agency personnel or staff members of the federal and regional offices 
with responsibility for administration of large federal programs of aid and 
service. Usually, the^D&U unit has very little influence with these groups other 
than through the persuasive power of its written products. 

The one area of large influence and control for the D&U unit is its own 
set of sponsored projec^is (heavy arrow) which mix research, development, demon- 

*^stration, dissemination, information services and consultation in various 
combinations. These projects can and often do act as a surrogate for or an 
extension of the D&U unit itsejf. Unless they are highly c i rcumscri bed by 
the language of the legislative mandate, they provide room for exploring various 
alternative strategies of D&U for various audienpes free from the entanglements 
of the federal bureaucracy. In some ways, the D&U up it forms a resource and 
mediating subsystem together with its set of projects, and thus the interface 

^•--^tween them becomes a critical focus t>f linkage. 
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We could go on. and on identifying these important interfaces, but perhaps 
the point has been made. Difficult as it Is to grasp this complexity, the 
D&U unit must try to do so, and it should also try to define Its priorities 
for linking and supporting J inkagewl tKIn tne mac rosy stem. 

B. CAN THE LINKAGE CONCEPT BE APPLIED EVERYWI^E" IN THE flACROSYSTEM? 

The most controversial aspect of our approach to D&U analysis may be 
ouY tendency to apply the problem-solving-df albgue-1 inkage paradigm (Figure 
3»1) to virtually every transaction in the spcial system. We will argue that 
this "broad applicatioh 6f the concept Is useful and appropriate, provided that 
At Is understood correctly. 

1 ■. \lt is a model, not a description of x^al'Ity. 

..In the first plac^^ It should be understood that this model 
does not necessarily describe 5n existing state of affairs for- 
any possible* resourcer-user pair. Communication may fn fact flow 
only in one direction and perhaps this is typically the case. ' 
Nevertheless, the model poses the question: how does a one-way 
exchange fit Into a problem-solving system? To answer such a 
question, we m\jst look at the' twc>-wc3j/ flow or potential flow ^ 
directly or through intermediaries 'whIch completes the cycle 
and ejtabllsh'es a quasi-stationary equilibrium. 



2. It IS a model, but not necessar i ly the projection of an ideal. 

We do not feel that all. or even most communlxat Ion ought to 
be two-way In any 1 i t^ral sen$e. People can be- Influenced \u a 
beneficial way by new knowledge which they had nothing to do with 
creating and for which they provide nothing in return. We would 
argue, however, that such successful transfer is far more ]Ikely 
when spme forethought has been applied to the message regarding 
Its potentlaT uti 1 1 ty for at least a hypothetical user. Figure 3«15 
suggests this sort of vicarious linkage. Indeed, ha\{Ing this sense 
of users, their needs, and their llke^ly response patterns is the 

[Insert Figure 3*15 here] ^ 

essence of good writing and of good direction and production in film, 
television, or any other one-way medium. 

It is furthermore quite conceivable that actual direct* 
communication from users will provide ifess adequate images of the 
ijisers'real needs and response patterns than the vicarious Images 
which certain creative resource persons can conjur*^e up by them- 
selves. * . 

3. Micro-linkage apiplle^to every interface In a macro^ystem.. 

Figure 3.7 and the analysis In Chapter Four may appear to some 
readers to indicate a series of one-way transfers which only link 
up when we look at the system as a whole. It is not our Intention 



FIGURE 3-15 



Successful Transfer with Vicarious Linkage 




to convey this meaning. On the contrary, it, can be argued that each 
sub-function in the analytical schema bespeaks (a) a transmission, 
(b) a transformatiori, (c) an interface between sender and receiver, 
and (d) a dialogue between sender and receiver regarding the function 
in question; Thus, 'the macrosystem of DSU might be displayed. as in 
Fhgure 3«16, with flow throughout being mediated by two-way problem- . 
solving dialogues at different levels. , ^ 

[Insert Figure 3.16 here] 

h. Interpersonal and i nterorgan i zat lonal linkages are different 
in kind but similar in configuration'. 

Figure 3«16 also illustrates another important tenet of linkage 
theory, namely that the same problem-solving paradigm can be applied 
to social organisms of any size, whether they be interacting persons,., 
groups, organizations, communities, reference groups, states, or 
nations. Poiht '*a'* in the figure may locate a dialogue between two 
persons at a given point in time or an accumulation over time of 
messages on all media transmitted between the two. Points b-1 and 
b-2 signify communication between the two organizations of which each 
person is a member. 'b-1' and 'b-2' also include numerous messages 
that may appear to be one-way from the point of view of any particular 
person in one organization or the other. Thus, it is not true that 
iriterorganizat ional linkage is merely the sum of all interpersonal 
1 inkages . 
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On the other hand, true interorgan i zat i onal linkage is usual 1 y 
dependent on interpersonal linkage within systems. Thus, if 'b-1' 
messages come primarily to person X and messages go out pri- 

marily from person Y, then X and Y must be firmly linked ('c'). 

C. ALL RESOURCERS AND USERS ARE NOT EQUAL 

Even within the smallest social groups, there is a hierarchy or prece- 
dence of influence which controls the flow of knowledge to a very high degree. 
The problem-solving dialogue needs to be considered within this context. \ 
Countless research studies in the field of communication point to the importance 
of opinion leaders as the primary means by which new knowledge comes to affect 
large numbers of people. Since the concept was first invoked over 30 years 
ago, 1 i teral ly hundreds of studies have built a body of knowledge on this 
topic which is highly relevant to our understanding of D&U systems. Figure 
3.17 suggests some of the patterns which we would predict for any D&U system 
as a result of these studies.* 

[insert Figure 3«17 here] 

Certain persons are likely to become aware of their problems and to 
reach out for solutions long before the user system as a whole has woken up. 
We could call these people "innovators.'* They are likely to be somewhat 
marginal to the great mass of users but to be more closely !n contact with 
media and with certain members of the RSD community. They are the kind of 
people most easily enticed into collaborative RSD microsystems and they pl^y 
a very useful role in this regard because they set an example particularly 
for leaders or opinion leaders. The example they set may be good or bad, i.e., 
if they succeed and prosper, the opinion leaders get curious and maybe jump 
on the band-wagon, sensing that to be left behind may mean to lose leadership 
status . If, on the other hand, the innovators appear to fail or to fumble 
around or to be hopelessly enmifed in unanticipated consequences, the opinion 
leaders hang back. • 

A similar set of social dynamics may occur within the RSD community itself. 
Though little research has been done on this,' there is no question that re- 
search specialties are dominaffid by a few stars who have inordinate influence 
not only on colleagues but also on policy makers and other would-be users. 

i. 

The purpose of this discussion is not to explore these possibilities 
fully, but only to suggest another set of variables which condition the 
problem-solving dialogue. Figure 3«17 suggests a number of hypotheses re- 
garding DSU systems which should be investigated. Unfortunately, they were 
mostly outside the bounds of the present comparative project. 



^Especially as summarized by Rogers and Shoemaker (1971 )• 
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CHAPTER IV 



INTERAGENCY COMPARISON ON OSU FUNCTIONS 



/. INTRODUCTiON 

It is the purpose of this chapter to compare and contrast the four DSU 
units on each of the six DSU functions presented in the previous chajpter. 
The information presented on each agency and its D&U^unit comes frorrninter- 
views with agency staff members^ which were conducted during the casei^study 
phase of the project. / ^^"^^^ 

A note on the data gathering/refining process is in order. As our / 
model evolved parallel to the case study interviewing, we coded items of / 
information in the interview summaries according to the applicable section(s) 
of the model. Since the model itself was not used to collect the informarion 
originally, however, and since there were doubtless errors of both commission 
and omission in our agency profiles, we returned to each of the DSU units 
for a meeting with staff members. In these meetings, staff brought errors 
and omissions to our attention and produced examples of activities to fill in 
gaps in their model summary. A corrected version of the profile was then 
drafted. 

The first section of this chapter entails a short summary of each agency's 
work in each area of the model. These summaries are intended only to provide 
the reader with a framework in which to place the detailed comparisons and 
are not intended to be complete characterizations of the agency or Its DSU 
unit. The second section presents a more detailed description of each 
agency's DSU activities as compared with each other and with a theoretical 
DSU model . 
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A. SJOMMARY COMPARISONS OF THE FOUR D&U UNITS 



Function Set #1. User Self-Servicing 

MAX I MAL ; An effective and progressive user sel f-seKvi ci ng subsystem 
has a good localized problem-solving capacity^ maintains a 
continuing awareness of its needs, present and future, 
knows how to express its ne;.eds to potential resource 
persons and groups, looks outward and inward for innova- 
tions, and is able to adapt new ideas. Maximal D&U activi- 
ties in this area would focus on helping the user help him- 
self by providing training or support on any of the above 
sub-processes. 



MA: 



Very little process helping is provided by the Division of 
R&D Utilization in the form of training or techniques for 
receiving or using knowledge; however, several Job Coaching 
manuals that have been developed or sponsored potentially 
servj this function. 



SRS: 



Although the Research Utilization Branch does not have sole 
responsibility or resources and capacity to fulfill user 
self-servicing. functions, they do attempt to link up to such 
efforts of other units in SRS. For example, RUB has played 
a major role in training efforts among the Research Utiliza- 
tion Laboratories and the Research Utilization Specialists. 
Much of this training has been oriented toward building 
human relations and problem-solving skills and is user- 
centered in emphasis. 



N IMH ; In the Mental Health Services Development Branch, user self- 

servicing is promoted by staff consultation to community 
mental health centers, "how to** manuals focusing on problem- 
solving procedures, and projects concerned with techniques 
of training for planned change. 

OE ; Although developing user self-servicing is not central to 

the mission of the National Center for Educational Communica- 
tioQ, there is an emphasis on training local intermediaries 
as special process helpers; the extension agents are supposed 
to serve as one method to give users technical and program- 
matic assistance in local ly- init tated problem-solving activi- 
ties. 



COMPARI SON : Across the four agencies, access _tj) c.llents_va4J 

resul t^of^Tstorical relationships with clients, mandated 

posture to them', size of the units, and level and extent of 
activity of . the client groups themselves. User self-servicing 
activities range from NIMH*s consul tat ion work wi th clients 
to MA*s past mission-dictated separation from line activities 
at the state and local level. Relative size of client groups 
to available D&U unit staff also appears to be an important 
factor. 
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Function Set #2: Need Process ing 

^^^XIMAL : Maximal D&U functions in the area of need processing would 
include various activities required to communicate user 
needs to resource persons and systems. Transformation 
activities such as need arousal, need sensing, need 
definition, and needs assessment are necessary for trans- 
mission of needs to policy makers and to the R&D community. 
Additional specialized transformations include the trans- 
lation of need priorities into research and development 
programs with dollar authorizations and into problems 
amenable to RSD, 



MA : Staff of the Division of R&D Utilization feel that they do 

not have primary responsibility for need processing or for 
determining the direction of the R&D program. ORD , as a 
whole, is responsible for need processing and the planning 
of future R&D programs; the. Division generally applies its 
knowledge of user needs in relating users to prodilicts of 
the R&D program. 

SRS : The Research Utilization Branch is involved in the Operational 

Planning System of SRS which allows for annual updating of 
objectives and design of research proposals to meet these 
objectives^ Although not the direct responsibility of RUB> 
needs are transmitted to various policy makers by means of 
the yearly R&D Strateg> ; other means of transmission include 
the R&D Brief Series , KU Specialists, and the '^Bidder's . 
Conf erence*** " 



NIMH : Need processing activities in the Mental Health Services 

Development Branch appear to be heavily influenced by re- 
searchers and by staff members working in consultation both 
with researchers and with mental health personnel. Although 
most need processing activities are carried put on an in- 
formal basis, more formal efforts include peer review panels 
and Branch-sponsored needs assessment projects. 

OE : In general, need processing activities in the National 

Center for Educational Communication seem to be stronger 
in the area of need transformation than in the area of need 
transmission. Although user need input is stressed in NCEC 
programs and projects, priorities are written into legislation 
and come down from the highest level. 



COMPARISON : In general, it appears that the four D&U units are only 

peripherally active in need sensing which has the objective 
of producing new R&D. The units do not serve as need moni- 
tors for their agencies* research programs; policy makers or 
researchers themselves tend to assume this responsibility. 
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There is more need sensing activity in the units for their 
own clients, and for the research the units produce. NIMH' 
closer link to its smaller number of clients results in 
the greatest activity as need-sensor. Two of the units 
(NiMH and OE) have undertaken formal need sensing studies 
wifh clients in the field; MA's and SRS's activities are 
formalized in the agency planning process, but not vis a\x 
vis field cl lents . 



-106- 



Function Set #3- Solution Building 



MAXIMAL : Although most sol ut i on bu i Id i ng functions lie outside of 
the domain of D&U, three processes can be Identified as 
maximal Dfi-U activities in this area: influencing R&D to 
be more relevant to society; influencing R&D to be more 
disseminable and utilizable; and research cn the process 
of utilization itself. 



Staff members of the Division of R&D Utilization are able 
to apply considerable pressure toward relevance and utiliza-* 
tion of certain applied research and demonstration projects 
through involvement in the "buddy system" and also by inter- 
vention in final report writing for projects. Several 
efforts have been made to conduct R&D on the D&U process, 
although many of these efforts have been more concerned 
with the improvement of D&U practices than with the D&U 
process i tsel f . 

SRS : Guidelines developed by the Research Utilization Branch for 

final report writing and "instructions" for grantees to 
include utilization requirements in their research proposals 
have influenced R&D output to be more usable and relevant. 
RUB has sponsored an evaluation of the RU Specialists plus 
other projects designed to improve the process of dissemina- 
tion and uti 1 izat ion. 

NIMH : Indicative of the pressure toward relevancy and utility of 

R&D in the Mental Health Services Development Branch is 
the list of criteria used by review panels In evaluating 
research proposals ; this list, developed In a Branch- 
sponsored project, includes items on project relevance and^^ 
utilization. Although there has been some difficulty in 
obtaining funds for research on the D&U process, several 
projects have been sponsored that have had effects on 
Branch operation. The Branch has no influence on research 
performed elsewhere in NIMH. 

In the National Center for Educational Communication, pres sure 

t cwa r d rele yaacy-^ d-iit M t ty "of R&D" I e n cou~r^gecl t h rough" 
proposal negotiation and in the development of new program 
areas but this influence does not extend to the bulk of the U.S.O.E, 
R&D effort. The application of R&D in the area of D&U is one of 
the five specified objectives of NCEC and staff have been very 
active in both producing and using research on D&U. 

COMPARl SON : All four units have made some Impact on the relevancy of 

research through' the guidelines, suggestions, etc. added to 
research proposal requirements; a somewhat greater impact on 
di ssemi nab i 1 i ty of research has resulted from requirements for 
final reports. There has been more success closer to home 
(i.e., in the R&D funded by the units), and only in tHe 
recent past have the units begun to have their guidelines 
imposed on all of the research sponsored by their agencies. 



MA: 



OE: 
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Function Set 

r. 



Solution Processing 



MAXIMAL ; Maximal D&U activities in the area of solution processing 
would include steps designed to move a valid solution 
idea into Implementation in a user system. Such functions 
as transforming knowledge into usable forms, transmitting 
knowledge to appropriate audiences, and helping people to 
use knowledge would be subsumed under solution processing. 

MA ; The Division of RSD Utilization is probably strongest in 

the area of knowledge transformations; packaging, tailoring, 
and targetting RsO findings to specific auldences is a 
primary concern as is screening for quality materials. Al- 
though the Divls^ion maintains an in-house, manual system 
nf storage and dissemination which generally allows them 
to provide documents at any time, this system operates 
exclusively for those products tliat have come out of its 
own R6D program and tends to be used most extensively by 
university RSD persons rather than practitioners or adminis- 
trators. The Division does not have the resources to be a 
"user helper" beyond Jndlvidual , informal cases. 

SRS : Knowledge transformations conducted by the Research Utiliza- 

tion Branch include such products as the R&D Brief Series , 
two-page summaries of selected projects that spell out 
implications for users; tailoring to specific audiences 
seems to be a major Branch concern. Transmission activities 
are not as well delineated as are transformation activities; 
however, RUB is in the process of developing an SRS-wide 
information system, and has developed a guide on how to use 
other existing information systems. In terms' of user helping, 
RUB acts as a linker to the various attempts at this function 
as performed by other units within SRS. 

Although the Mental Health Services Development Branch has 
not concentrated Its efforts in the area of knowledge trans- 
formation, two .new magazines, I nnovations and Evaluation , 
have been designed as transformation devices. In terms of 
transmission activities. Branch efforts are handicapped some- 
what 1^/ the decent ra U-zed--nat^^^=^--ef- N444H^ 

members employ both formal and Informal means to insure that 
knowledge reaches relevant audiences. Manuals, field con- 
sCiltdtion visits, and training projects are designed as user 
helping mechanisms by thre Branch. 

Within the National Center for Educational Communication, the 
Educational Resource Information Center (ERI C) car ries the 
bulk of transformation activities for the DSU unit. In many 
respects, ERIC is a model system equipped to do all of the 
print-based archival, integrative, and transformation functions 
necessary to give users complete access to the storehouse 
of knowledge in a major social problem area. Although trans- 
mission activities are not as strong as transformation activi- 
ties in NCEC, there is a trend toward i ncreas ing vthe realm 
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of these functions. NCEC employs various means to help 
users implemej[!t innovations based on R&D; for example, a 
system of extension agents will be expected to provide 
developmental assistance to local educational practitioners 
as part of thei r role, 

COMPARISON : Three of the four agencies, MA, SRS, and OE, are strong 

in the area of knowledge transformations. None of the four 
DSU units are as heavily involved in transmission activities. 
SRS, NIMH and OE provide some user helping functions in terms 
of consultants and linking agents. 
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Function Set #5- Microsystem Bui Iding 



MAX I HAL : Microsystem building refers to activities in which many 

elements of the problem-solving dialogue are simultaneously 
present and are allowed to interact on a small scale. 
Maximal DfiU functions in this area woul d incl ude inter- 
changes between researchers or developers and users, user- 
collaborative R&D, and integrated RDD&U programs. 



MA: 



In the Division of R5D Utilization, emphasis is placed on 
interchange situations, although these now occur on an 
informal basis. Oser-'col laborati ve R&D also is stressed 
In the Division: in the mgdel "projects as dissemina- 
tors," user involvement is encouraged in the early stages 
of projects. A good example of integrated RDO&U programs 
supported by the Division would be the Experimental Manpower 
Laboratories set up in priority areas of needs. 



SRS: 



The Research Utilization Branch is beginn'ng to experiment 
with the use of researchers "on-demand and on^-call"; other 
such interchange situations are also promoted by RUB as are 
user-collaborative R&D projects. Examples of integrated 
RDD&U programs include that of the Public Assistance in 
Vocational Rehabilitation program and various activities of 
the Research Utilization Laboratory in the Jewish Vocaticnal 
Service. 



NIMH: 



Of the three functions subsumed under microsystem building, 
the Mental Health Services Development Branch appears to 
be strongest in the area of integrated RDD&U programs. The 
most salient example of such programs would be Branch efforts 
directed toward the children's area priority.. TH6 Branch has 
also sponsored some user-collaborative R&D projects, and 
although interchange activities havS'been encouraged, limited 
funds have prevented the Branch from being able to develop 
the full potential of these interchange situations. 



OE: 



The National Center for Educational Communication appears to 
have had Irttle direct Involvement in microsystem building 
between researchers and practitioners throughout the educa- 
tional establ ishment . However, increasing attention is 
being paid to the role of " NCEC in this regard , and efforts 
toward building user-collaborative R&D and Integrated RDD&U 
programs are being recognized as necessary prerequis i tes to 
user installation of R&D products. 



COMPARISON ; For microsystem building, system complexity appears negative- 
ly related to the proportion of effort expended in interchange 
and combined R&D and RDD&U projects. OE, in particular, had 
fewer such activities, although it is moving in that direction. 
The otner three agencies, especially MA and NIMH have engaged 
in diverse activities involving these functions. 
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Function Set #6. Macrosystem Building 



MAX I HAL ; Although moit macrosystem building functions Ije outside 

the domain of any particula-r unit within an agency, several 
processes can be identified as maximal D&U activities in 
this area.: modelling cjf the macrosystem, ironitoring of the 
macrosystem, promoting llfikage, filling recognized flaps, and 
building system awareness. 

MA ; The Division of R&D Utilization stress.es the development of 

Informal linkages within the Manpower Admi ni 5trat ion'; "one 
method used for this purpose is the "buddy si/stem." Linkage _ 
between macrosystems is also emphasized. These linkages are 
helpful In terms of bi'ilding awareness of the utilization 
system and in macrosystem nK)delling. Utilization laboratories 
have been supported where research, dissemination, and research 
on utilization can go on simultaneously with longer-term 
planning and funding. 

The Research Utilization Branch has been working toward the 
development of an SRS-wide utilization system; however, lack 
of a common perception of the system has been a problem. 
RUB has stressed the importance of building networks and has 
served as a catalyst in many SRS efforts, e.g. , research 
utilizati'on specialists as linkers to the states. No unit in 
SRS has- respons ibi 1 I ty for building system awareness, al- 
though it appears that the new management procedures may be 
directed at this function. 

NiMH : The Mental Health Services Development Branch is not in a 

position to engage In macrosystem building for NIMH; al- 
thoiugh there have been some efforts by NIMH as a whole to 
do this, past efforts have not been in the area of DSU. 
However, Branch merrtf^ers are participating in a newly-formed 
Study Group that is concerned wi.th the problems of linkage 
and' D&U in the NIMH system. 

The National Center for Educational Communication has done a 
great deal of gap filling and institution building. The 
network of specialized linking agents based in state agencies 
and the nineteen subject area clearinghouses within the ERIC 
system are examples of macrosystem building activities. In 
terms of system mapping, a study of the educational Information 
need sensing network has been funded as has Another national 
survey of innovation process and information use in school 
districts, 

COMPARISON ; There is quite a bit of variation in DsU unit activity in 
the area of macrosystem building. SRS and NIMH have been 
less active, comparatively, but for different reasons: in . 
SRS the difficulty has been the lack of an integrated system 
to be modelled; in NIMH it is perhaps the difference in approach 
between the D&U unit and the majority of NIMH subsystems which 
Is the cause. 



SRS: 



OE: 



ERIC 



B. DESCRIPTION OF D&U UNIT FUNC>1-6NS: MAXIMAL VS. ACTUAL 



In the pages which follow, we will offer side-by-side comparisons of 
the activities of a theoretical D&U process, which provides a1 1 of the six 
function sets described in the previous chapter to the fullest extent, 
with each of the actual DSU units studied-in this projectT The theoret i cal 
model should be uhderstood as the maximum rather than necessarily the opt i mum 
model, especial ly in consideration of resources available, legislative mandate, 
and o^her const/aints affecting the actual agencies studied. These are acti- 
vities we see as necessary for an agency, but not necessari ly the job of any 
one O&U unit. - ^ \ 

The categorical analysis which fol lows must be understood in the light 
* of the analytical framework and rationale presented earl ier . It cannot be 
uhderstood outside of that context. 
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Flection Sat §\ : 

USiit S6Lr>S£RVtCiW6 



1 . 10 Oeveloptng User's I n- 
lefnal Problem-Solving 
Capabl \ \ ty 

( t IS important for 
user<v to have adequate in- 
ternal processes of solving 
problems/ fynefimes users 
ne«d help o^ hOM to 'help 
themselves without such 
"ht being focused on 
specific pieces of research 
knowledge but rather on the 
user's own situation and 
own problems/ 

The (naxitnal D&U system 
is able to provide general 
prob lenrsol vi ng process lielp 
In the form of: 



Training in effective 
prob lem-sol V( ng procedures 
Including diagnoses, setting 
objectives, resource link- 
ing, searching for and draw- 
ing implications frofti re* 
search » finding and choosing 
araong solutions, adaptation, 
trial and gaining acceptance 
for solutions. 



■V RAD Utiliiinicn 



The Division appears to do very little 
process helping in the sense of providing 
either training or techniques for receiving 
and using knowledge. This might be an area 
for future expansion effort, although pre- 
sently providing direct services is not a 
part of their mission and would certainly 
rcqui re more staff. 

Program admi ni tt rators , e.g., USES and 
OEOP staff, are seen as having the responsi- 
bility of preparing the state and local 
offices for msk'lng use of Itnowledge, al- 
though It was not clear from interviews how 
central RiD knowledge wis in this process. 



It appears that no unit has sole responsi- 
bility for this function, and some training 
efforts appear in various units. Some eval" 
i?.")tion studies sponsored by OPE may assist 
tn the development of user diagnoses, since 
OPE tries to invojve users during the life 
of these evaluation contracts. This may 
also be an area of expansion for USES, since 
~the State Employment Service Offices have 
training divisions. However the training, 
up to the present, has not been organized 
around the development of problem-solvfng 
procedures; rather, efforts have beeri 
focused on training staff for specific pru- 
g rams . 



Haa^.2rcfi 'Jtx UtatiK^n fi ranch 



Rub does not have sole responsibility for 
user self-servicing, nor does it have the 
resources and capacity to fulfill these func- 
tions. Indeed, some of these functions have 
been assigned to other units in SRS. RuB 
does see the need to link to other user self- 
servicing efforts, when they do exist, to 
insure th&t utilization of research becomes 
•n integral part of these other training 
efforts and to Insure that the "bases are 
covered" by someone, 

for users within the SRS staff (eg., 
department heads and other personnel in 
federal and regional offices), increasingly, 
this function will be assumed by the recent- 
ly created Office of Organizational Develop- 
ment. This Office will provide special 
training to SRS staff and will conduct courses 
on problem-solving and the processes of 
management -by objective and system analysis, 
all of which could be viewed as developing 
capability in a specific user group. 

The RUB, by ltsel^^.ha^ few resources for 
developing process training or providing 
techniques for receiving or using knowledge. 
However, it appear^ that the Manpower Utiliza- 
tion Branch in thfc Rehab i I « tat i on Service 
Administration (R&J in co 1 1 abo ra t ' n 
RUB has potentla^l for this tvpe d' ira - 
and this potential has been tappec ** a ^e^ 
instances (e.g., in the training cf rese»rc*» 
utilization specialists by RUB and RSA] . 



RUB has assisted the Institute for the 
Crippled and Disabled (ICD) in New York City, 
one of the RU Labs, In developing a clearing- 
house to support the Public Assistance 
Vocational Rehabilitation (PAVR) program. 
ICD Is also working toward the development 
of training material that wi U enable the 
state client group to use this information 
system In their own work wfth public welfare 
clients. Using short-term training money, 
RSA also developed a document in support of 
the PAVR project which Indicated models for 
utllizino the expansion grant program. 

In building the abstracting effort *or 
the SRS information system, RUB and RSA are 
also using short-term training money to 
develop models of how to use the informaton 
system The end product wi M ^e ; manud« 
indicating the various ways of u>ing the 
system, how to enter It, etc. 



o 

ERIC 



STHH Mental Health ^Vnajit? Ueve loprrmnt Branch 



MiiCh of the work of the HHSV staff. In 
consultation with their clients, appears to 
be directed to this area, with consultation 
centering on problems of the centers rather 
than fccus^lng on specific pieces of research. 
However, the extent of such problem-solving 
consultation among all of the Branch staff 
members is not c!ear» especi«.lly given their 
other duties. 



Some of the projects sponsored by the 
Branch may promote this type of traliU'ng. 
A portion of a new project with the Human 
interaction Research I ns t t tute wi 1 1 be 
designed as a training project to enhance 
Branch staff members* skills in consultaCjon 
to',|>rbmote change. One other project supports 
trainihg in operations research. 



Ot SatioKdl center /.t Eck«yational 
Cormunic ali on 



Developing user s^lf-prc^lem solving 
capacity is not central to NCECS mission, 
although various 0£ training programs over 
the years have focused on this area, e.g.. 
Cooperative Project for Educational Develop- 
ment (COPED). In theory, at least, the 
extension agent system which is now being 
developed is supposed to serve as one 
method to give users technical and program- 
^matlc assistance In locally-Initiated 
problem-solving. NCEC staff often reflected 
this philosophy \n their responses. One 
noted that NCEC shotild not have the function 
of technical assistance as it has to be 
provided from the tnlertnedlate or local 
setting, bringing In experts when needed. 
In order to train practitioners as effective 
resource-utilizing problem solvers, it was 
felt that a complete transformation of what 
OE Is doing now would be required. As OE 
funds for training are administered through 
the National Center for Improvement of 
Educational Systems (a sister unit to NCEC), 
it is hoped that NCEC can Influence their 
planning in the future, although NCEC has 
not done so In the past. 



NCEC uses workshops, training sessions, 
and technical consultant services \n the 
area of process training. There is an 
attempt to train dissemination representa- 
tives in the methods for disseminating 
technical Information to educators and to 
assess and upgrade their understanding and 
skin In linking to resources and In problem- 
tot vtng. 
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Providing use/s with 
structured procedur«b for 
problem-sol vi ng. 



; ,20 tser Weed bareness 
and %m\f Sensing 



1 ,30 User Heed Expre*^ion 
Articulation 



Some documents which the Division has 
developed or sponsored potentially serve this 
function, e.g.. mOTA EsO Findings Number 5, 
1969, and the Job Coaching Manuals produced 
by outside contractors (a good example Is 
the Gordon-Erfurt Coaching Manual, 1971). 
Production of similar documents Is being 
encouraged by the Division. A "how-to-do- 1 1** 
handbooli was developed from the "Older 
Worker" study, and has been distributed' to 
the various State Employment Service Offices, 

Occasionally, the Division of Policy 
Studies and Analysis in OPE develops Impli- 
cations, foltow-up proposals, and programs 
from ORD reports and evaluation studies for 
policy-makers in the OOL. 



No activities are focused directly on 
this, nor is it part of the Division's defined 
mission. However, Staff within ORD have 
cited cases where presentation of research 
results has "generated" interest and aware- 
ness within users, particularly among policy- 
makers, involvement of users at the federal 
level in the development of the annual R&D 
plan may indirectly develop some awareness 
among these program administrators. 



- This function appears to be done only 
|ndir*jctly within ORD through meetings with 
federal program people in the development 
of the annual R&D plan. It was staled that 
users' suggestions 4s to needs often were 
too '.hort-'.ighted for planning two to three 
years in advance. Vet It appears 4hat there 
has been no attempt to ^A^hn6 tha ability 
of users to articulate their own needs, nor 
was there any office with this defined re- 
spons ibi ) 1 ty . 



SKS Xtftt^ai*ch int\ization Branch 



In training the RU Specialists them* 
selves, a staff member from the RSA Manpower 
Utilization Branch reported that they had 
tried to "capitalize on their own (the RUS's) 
1earnln9, to help them Identify what's going 
on, and to help them feed this information 
to each other.** It is not certain whethe 
this strategy has been used to train othc 
c) lent groups . 

Some documents being developed in RUB- 
sponsored projects, e.g., the hondbook being 
developed From the review of research in 
the area of psychiatric rehabilitation, may 
also serve this function. 



In another step to develop the R&D 
Strategy, Jt new **Tssue general i on" 'procedure 
has been instituted. Each of the bureaus is 
allotted $200,000 to define their needs, 
objectives, and problems. Each Dureau will 
organize a six-man team for this purpose, 
with a full time staff member from the Urban 
Institute assigned to each bureau to assist 
these teams. This process will encourage 
need awareness among users at the federal 
level. 

The RUS's and RUL's can also be viewed 
as catalysts who encourage self sensing 
among the state client group, given their 
links and consultative efforts within the 
States. 



The major efforts In this area would 
Include the previously-mentioned work of 
'the RUS's and RUL's as catalysts for the state 
client group and also the creation of (he 
"Issue generation" teams <n the bureau*. 



ERLC 
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NIMH Mental Healch i»'^rvic?ee DeveLopcrvnt Branch 



On« ^1HSV s.iaff merri>er d«scrlbed the 
purpose of the research they sponsor as that 
of helping to develop knowledge about how 
to solve problecn<i of the local mental health 
centers. Thus many of the projects, e.g., 
the goal attainment scaling procedure to 
assebs achievements of local centers, Involve 
the development of specific problem^solvlng 
toolb. Manuals are sotnetimes developed by 
the project staffs. 

The consul tat ioTt ac t i vl t i es/of Branch 
staff also cover this area. One staff member 
noteo that on such consultation trips, the 
center staff may cite a specific problem 
that they have, and the Branch consultant 
tries to find out ^r.'hy they have this problem 
and encourages and assists the center staff 
In study.Ing and evaluating the problem. 

The NHSV also has developed some "how 
to" manuals which focus on problem-solving 
procedures: a manual on hciw to use informa- 
tion sources; a manual on program evaluation; 
a manual on research utilization. 



The program evaluation manual, plus 
several national and regional seminars and 
symposia, has t>^en intended to promote need 
awareness . 



Through some of the projects sponsored 
by the Branch, e.g., the program evaluation 
technique development, and through consulta* 
tlon efforts, need expression articulation 
may occur. One Branch staff member mentioned 
trat :he purpose of center visits may be an 
e/j^use for the center staff to get together 
a*"^ "'.9\^ up 4 storm'' among themselves about 
tneir ne<bd% ard problems. In such cases, 
the p^'esence of the HHSV staff member may 
serve as a catalyst for the client's own 
need assessment and articulation. 



OS Hatii'^nul Onf^r for Bduoational 
Ctmfiunioatu'n 



NCEC has supported one project to 
develop a manual, checklfsts, and training 
models for improving problem-solving and 
kn^ledge utilizing skills. Intended users 
of these mateHals are a broed strata of 
educational practitioners in state and focal 
agencies who would be identified as innova* 
tors or change agents. 



Although. this activity lies far outside 
NCEC's formal mission, there Is some stress 
In the extension agent system on dialogue 
with users to help users Identify their own 
needs. There Is also a current contract 
which is attempting to develop need sensing 
methods and Instruments which users can 
self-admlnlster. 



In NCEC, there has been an extensive 
history of attempts to get user need sensing 
input through formal user need studies. 
Special surveys of individual projects (e.g.. 
file partitioning), and in the development 
of specific products. The QUERY negotiation 
process also Involves users In defining their 
ONn needs. Every Target ted Communication 
project Involves some kind of usftr need 
Input. 

As noted above, one of the objectives of 
the extension agent system Is for the agents 
to enter into need assessment dialogue and 
problem definition activities with targetted 
populations. 



ERIC 
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\ Oevelop^nQ User Inter' 
est, SkiH, and Capa^ 
city for Seek! rig Out 
UseiPul tnfonnatlon and 
Opennens to . Hew Re* 
search and Pevelopiiint 
Findings and Ideas 



1 .50 Developing tn User a 
Capacity for Adapia* 
tion and integration 
of Solutions 



H.A, fHviaion of /fiO UtiliMation 



No activities of the Division are focused 
directly on this function. However, the 
Division assignment to develop communications 
with the regional offices Is hoped to allow 
the regional staff to know what Information 
is available in ORD and how they can use it. 

One of the barriers commonly cited by 
ORD staff in developing this capacity for 
openness to new RtD is the feeling among 
potential users that they do not have enough 
money to put E&D into programs: "It's a good 
ldea» but give us the money." 



Again, there may be potential In USES 
regarding this function, since the State 
Employment Service Offices have training 
units. But such training Is not now focused 
on this function due Co lack of time and 
resources . 

Staff of the Division of R60 Utilization 
feel that they do not have primary responsi* 
blllty for need processing and for determining 
the direction of the R&O program. Rather, 
the Division generally brings its knowledge 
of user .needs to bear in relating users to 
products of the R&O program. ORD, as a whole, 
is responsible for need processing and the 
planning of future R&D programs, and this 
planning process has been described as a 
"conectlve responsibility." 



Sf^ h^ee<xi\^ Utilization Bvan<yh 



The ICO effort (with assistance from 
staff in SRS) to develop training materials 
that will enable clients to use the ICD 
clearinghouse in their own work may be 
building this kind of capacity. 

The manual to be developed from the 
abstracting and indej<ing contract for the 
SRS Information system should also encourage 
growth of thi s__capaci ty . Various projects, 
including the RUS's and RUL's, the Stout 
State, Wisconsin, project to develop a 
clearinghouse and generate issues, etc., will 
certainly build this capacity among project 
staff members, and it is assumed that the 
work of these project staffs will have some 
impact in developing this capacity in broader 
user groups, e.g., the state clients. 



In eight to ten "Operation Research" 
projects funded by RUB, lectures are con- 
ducted for state agencies on the topic 
of research operations; this activity is 
intended to promote research capacity build- 
Ing among state personnel. The RUL In the 
Jewish Vocational Service (JVS) , Chicago, has 
been cited as an example of a user- researcher 
group which has been developing this capacity 
in themselves as well as promoting its develop- 
ment In its larger user group. The RUS's 
also ^actively encourage this capacity in 
their clientele through their efforts. Until 
the evaluation of the RUS's is complete, 
it will not be known how effectively the RUS's 
can but id this capacity among users. 
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OE Sat! >f},il Center for Educational 
Coirrruriicat ion 



Again, the manuals developed by the IIHSV 
on iyot to use Information sources and on how 
to p'an for creative cf.ange may assist In 
the development of thfs capacity In users. 



One Branch effort which appears to focus 
on th s activity would be the consultation 
of Branch staff with clients. This consulta- 
tion holds much promise in developing this 
capacity among users. The manuals on research 
utilization stress, in actuality, hoM to 
foster organixat ional change. Also, several 
new projects, in planning stages, will test 
and demonstrate deliberate techniques of 
planned change. 



This Is the core philosophy of the 
extension program which is planned. Agents 
are supposed to act as catalysts and get 
users started on the path to sel f- in 1 1 i ated 
•^esource acquisition. By making users 
familiar with Putting Research Into Educa- 
tional Practice (PREP) and ERIC materials, 
agents open up to users a new avenue to 
proble^^-solving. There is not vet enough 
evidence from the pilot agent program to 
indicate whether such contacts will actually 
lead to user sel f - inl t lat ion in acquiring 
resources over time. 

Kany of the motivations For change in 
the local school districts arc' not self- 
motfvations, but rather come from sources 
outside of the school system Itself, e.g., 
pressure from outside generated by students 
saying that they aren't getting a relevant 
•aucatlon. Although these outside pressures 
for school Improvements allow a climate in 
which RtD products can be marketed, they 
also act as inhibitors since there may be 
built-in resistance to change. The proposed 
change fn validation efforts, having states 
nominate programs to be considered for vali- 
dation, might provide local school systems 
with alternatives to present procedures and 
allow them to learn to look at information 
that is presently available before they stare 
new programs. 



Follow-Lp activity to help clients in 
both adoption and Implementation of innova- 
tions Is another aspect of the emerging 
extension sys tern; "developmental assistance" 
is one important part of the extension agent 
role. As one respondent noted: "You have 
to process beyond the point at which you 
fulfill information requests with the printed 
page; you must help (practitioners to) ex- 
plore ways they can use Information, help 
Interpret, and get people in for consultant 
help." Visitations and technical assistance 
sites also serve this function for specific 
solutions. 

A contract'wi th Contemporary Ri;-.earch 
is designed to provide a turnkey capacity 
to foster the adoption'and adaptation of 
eight Title III programs earlier Identified 
as exemplary programs. 



Function S»t 12; 
NEED P>tOCESSH<6 



Naximal DSU^ System 



2.10 Need Arousal 



The maxima) O&U systtin 
should be able to stimulate 
coi^ldcert users to s».art 
fcei ing needs . 



2. 20 Need Sensing 
(SItni lar to 1 . 20) 



2.30 Weed Def ini t ion and 
Redef inl tlon 

The inaximal system has 
an evolving definition of 
the need domains of users 
which includes present 
and future, substance and 
process » explicit ar^ 
inferred. 



M.A. [Ku'aicm of RID UtiliMation 



Need arousal Is only done indirectly for 
the most part, although in one conscious 
strategy of ."ui i U zat ion by subversion" the 
Division attempts to develop new directions 
in the thinking of establishment professional 
groups by giving then special dissemination 
contracts. Users are also stimulated on a 
selective basis by products, demonstrations, 
discussions, and conferences at-which the 
Division representatives are offering facts 
and solutions. The net effect on son>e users 
nwy, of course, be an awakening to their own 
needs . 



No formal strategy has been developed 
within ORO for need sensing. Lack of a 
direct relationship with state employment 
services and other manpower services at the 
slate and local level may be one reason for 
this- -and a strong one. Various members of 
ORD undoubtedly use :hcir links with users 
to seni»e needs on a micro-scale, although 
the feedback of this need sensinq into the 
development of R&D plans is not formalized. 



For the most part, those in authority 
above the Division are responsible for antic- 
ipating need domains of the clients. Such 
definitions change frequently, reflecting 
the interests of the country. Various sources 
of obtaining definitions of need were cited: 
some notions of need domains are developed 
by special In-house contnlttees, e.g., the 
Hanpo%«*er Administration *'study group" which 



There is no direct strategy to do this, 
although some Branch staff meirtbers felt that 
in-house written materials, e.g., development 
of their R6D Strategy, have served the 
purpose of ''it Imul at Ing thought'* among 
policy makers In the area of O&U Itself. 

A different group of users Is also 
stimulated through various means. Written 
products, e.g., the RSD Briefs , are Intended 
to alert users at different levels to new 
Ideas and research conclusions, which could 
iead to need arousal. Various conferences 
as well as RUS contacts with clients can 
also stimulate thinking and concern about 
needs . 

Another Indirect source of need arousal 
are the central office mandates presented 
to various groups. For txample, it was felt 
that need arousal occurred among the state 
agencies thrnugh the institution of new 
federal objectives. At the federal level, 
need aroU&al may occur among program people 
by means of the new procedure in which 
policy Implications are presented to the 
bureaus and In which, In turn, the bureaus 
are held accountable for accepting or re* 
jecting the conclusions and implications. 



Need sensing nay occur among the federal 
staff through their participation in the 
procedures established to develop the annual 
RtO strategies. The work of the RUS's and 
RUL's with the state client group i*,. agaln^ 
intended to promote need sensing on the pan 
of the stale user group; yet the effect i vene«.s 
of the RUS*s and RUL's in promoting ihis 
capacity is not yet known. 



Traditionally, the direction of research 
toward general areas of need had been in- 
fluenced by researchers. However, definitloti 
of need domains has become more formaUzed, 
with yearly objectives decided In-house 
and with more and more Input on needs and 
priorities from policy makers within SRS 
and HEW. "Issue generating" teams in the 
bureaus define need domains as well as problem 
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NIMH Merc n h(salth Jf^tvioye Deve lopment iir<inaK 



The mechanism available to the Mental 
Health Services Development Branch (MHSV) 
that would allow for need arousal is the 
consultation services that staff provide to 
community mental health centers and other 
mental health personnel. One HHSV st^ff 
member stated that people must be "helped" to 
know what they need: "you move people along 
by building on the Information that they 
(clients) give you; make them curious." 
jThis c:>nsul tat ion would indeed appear to be 
fa potential mechanism for need arousal; how- 
ever, it Is not certain whether this strategy 
of consultation is used by all Branch staff 
or even how much staff time is available 
for such consultation (staff members men- 
tioned other pressing duties which cut down 
on time for such visits). 

Some non-Branch respondents felt that 
need a^'ousal occurred to some degree among 
users other than mental health personnel. 
For example « pamphlets, use of television 
advert semcnts, etc., were mentioned as 
method^ for need arousal for the general 
public, whereas conferences, workshops, and 
even the review panel experience were suggested 
as means for stimulating thought for r«- 
searchers . 



Ir a study that is Just beginning, the 
American Institute of Research is going to 
canvas^, community mental health centers to 
obtain the centers' definitions of their own 
problems. There are no other systematic 
activities focused directly on need sensing, 
despite concepts and techniques that have 
been published by HHSV. 



Traditionally. N)HH research programs 
have operated under a "free enterprise system," 
with resear».hers spontaneously bringing In 
ideas and applications. The direction and 
defined need domains of NIHH research programs 
have been heavily influenced by researchers 
through the use of "peer review" panels. Each 
research program In NIHH has at least one such 
revlM^ panel (there are over ^0 panels In 



Nat Lffuil Center j'cr Educational 
Ctfi'muttiiXit ion 



Need arousal for policy makers on the 
area of DtU is accomplished by keeping key 
people in OE well-informed of the services 
and products NCEC Is delivering. Presenta- 
tions at OE-wlde seminars on the topics of 
dissemination and the Copyright Program 
have increased the number of requests for 
Information services as have such presenta- 
tions to non-OE groups. Visits to state- 
level staff members are utilized as oppor- 
tunities to raise the priority level of 
dissemination by informing them of what NCEC 
has to offer in terms of helping the state 
agencies. Need arousal can also occur 
through Clearinghouse linkages to professional 
organi zat Ions . 

BESE is conducting an Education Innova- 
tion Fair whereby state people working in 
Bureau programs are invited to review their 
programs through "Awareness Sessions" and 
"Adoption Clinics." The objectives of the 
Fair Include stimulating the states to 
hold their own Fairs both on a regional and 
state basis, encouraging traveling seminars 
for demons tratura to take their projects to 
locals, and encouraging interchange among 
people. 



As previously noted, one current contract 
(Stanford University) Is devoted to developing, 
methodologies for user Information need sen- 
sing and will provide data to NCEC on repre- 
sentative needs from national samples of 
users In various practitioner categories. 

The Bureau of Adult Vocat i ona I -Techn I ca i 
Education has supported the development of 
a number of "research coordinating units" 
(RCU) across the country to Identify resear-ch 
priorities In the states and set pr lor i 1 1 eii 
for R&D In their state plans. They determfne 
these needs in various ways, such as having 
advisory councils set up to advise them on 
policies and priorities for research. 



The definition and redefinition of 
needs is strongly Influenced by the priority 
setting of the OE top echelon. Political 
changes at that level often bring new leaders'* 
with their own concepts and priorities. For 
example, the shift In OE to "getting Into 
the classrooms" has produced a shif.t in 
the focus of ERIC from serving the researcher- 
scholar community to serving the practitioner- 
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2ii kO Quant i tat ive Needs 
Assessment 

\ The maximal system has 
a continuing workable pro* 
cedure for user needs 
assessment both in quant i* 
tative and qualitative 
terms. 



M.A. Diviei, 



t<:iV Uti ! ."it i: 



defined the area of needs resulting in the 
Work Sample Study project. The National 
Manpower Policy Task Force is contracted to 
sense general areas of need, and ihe Kational 
Manpower Advisory Committee has a Research 
SubcommUtee which suggests priority areas 
for research. In-house policy makers, e.g., 
the committee composed of the Assistant 
Secretaries and Und>«r Secretary of Labor 
and also staff of ASPER, are Involved In 
priority determination. 



There is no formal or regular quanti- 
tative needs assessment procedure » but 
thought Is given to the process. Means of 
involving the user 1" the project* including 
obtaining users' convnents on proposals and 
•neettngwith users at the federal level, were 
considered procedures to assess users' needs. 
Some indication of needs arises from program 
statistics, evaluation reports, and also 
from suggestions of the researchers. "Antici- 
pation" of policy concerns o|.DOl policy- 
makers was cited as a means of need assess- 
ment» as well as "idea stimulation" (e.g«, 
the identification of problems not dealt 
with by existing legislation) among staff 
of ORD. Although the Division staff and 



areas for research. Although the definition 
of needs may change somewhat from year to year, 
most staff seem very aware of the defined 
areas of need. 



A management procedure which has been used 
for three years by SRS provides for a mo-e 
formal assessment of -program needs at the 
bureau and regional levels. In the develop- 
ment of the annual R&D Strategy, bureaus and 
regions provide various inputs: the bureaus 
define their goals and object! ves, identify- 
ing knowledge gaps around each objective; 
specific research proposals are then designed 
to fill the Identified gaps by "teams" (in- 
cluding ^n ORD staff member, the bureau 
heads, and possibly a staff member from a 
regional office); after review of proposals 
by ORO and perhaps higher officials, the 
refined strategy go«s back to the bureau for 
their further comments. 



ERIC 
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NtHH) composed of outside « establishtd re- 

searchers and professional experts in the 
particular area of concern, These panels 
review a^! of the grant applications of the 
research programs and make decisions as Co 
project funding. Subsequently, the National 
Advisory Mental Health Council reviews all 
decisions made by the panels; thus, researchers 
have had considerable decision-making authority 
In influencing the direction of research. 

However, there have been some changes 
noted In portions of the Institute. The MHSV 
noted a significant change from their pfwvious 
"laissez-faire" attitude; a staff member 
estimated that by FIscfl Year 1973, over $0% 
of the Branch grants would be "collaborative/* 
I.e., selected with Input from Branch staff 
as weU as from the review panel. 

Recently, on an Institute-wide level, 
priority topics of the agency have been listed: 
topics such as the children's mental health 
area, Integration of services, etc. Plans 
for the letting of contracts for evaluations 
administered by the OPPE also were recently 
designed to correspond to KIKH and HEW-levet 
operational goals. Some of the problem-' 
oriented Centers in the Division of Special 
Mental Health Programs^ e.g.» the Center 
for Studies of Crime and I>e 1 i nquency , have 
Identified critical priority areas for re- 
search and program emphases which will be 
the'r major responsibilities. Yet, «s one 
•xjves into the less applied research programs, 
resDondents indicate that the "free enter- 
prise system" stlH exists, with less attention 
being paid to defining need domains. As one 
respondent from a basic research program said, 
"we don't put any priority on any particular 
kind of new knowledge." 



One of the major phases nf the MHSV's 
RtO mission has been defined as the "evaluation 
of needs, gaps, and problems fn the Me U very 
of mental health services." Thus, need assess- 
ment is considered to be an Important Branch 
activity and varlou- way. were cited to get 
at user needs. Researchers themselves have 
provided input on needs through a nurrtier of 
means: the peer review panel provides Input 
on needs; in the children's program area of - 
the Branch, a "cadre" of NIHH experts In this 
area has been formed to provide inpvji on 
program needs. Branch staff have made use 
of their consultative site visits to mental 
health centers, program statistics, Jnd 
even initial and continuation grant jpplica- 



OF Natioyiai C9nter for Kduaational 



d«cUion maker community. One informant 
outside NCEC noted that the Commissioner has 
strong Influence In directing needs, and added 

that the only Impact his Bureau has had on 
the Commissioner was when the Bureau was 
asked to cite the states' priorities; these 
"priorities" were almost like "fashions" or 
"fads." Concern in the Commissioner's Office 
for the Bureaus to establish a closer liaison 
and feedback relationship to the educational 
community has prompted thought In that Office 
toward the development of a committee of 
college presidents and knowledgeable people 
to discuss OE priorities. 

Resource allocation decisions are nade 
at the Deputy Conmissioner level, with the 
Deputies being given a celling budget for a 
five-year plan and the responsibility for 
distributing the budget among the programs 
under them. They do get some broad external 
guidance from the HEW level, the White house, 
and Congress, and Internal guidance from the 
OE philosophy of educatjon. 



The previously mentioned user need 
methodology study may provide the basis for 
continuing quantitative needs assessment « 
and the development of n need "sensing net- 
work." Otherwise, user needs arc determined 
by proposals that come in, e.g-, Targettcd 
Cunnunlcat Ion Project proposals: when a 
proposer picks a prublcm area« he has to 
prove that It Is a problem and that there 
Is knowledge to be applied to the problem. 

The dissemination representative) In 
the state agencies hold meetings at least 
three times a year to give feedback to NCEC 
on their needs. One of the activities In 
the exteniion agent system is for the 
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other ORO staff maintain informal contact 
with program people at the federal ievei. 
this contact has nor served as a direct 
source of input into R&O planning. 

It was generally agreed that suggestions 
as to needs from users tended to be pedestrian, 
resulting In "laundry lists of needs." More- 
over, ORD had to be thinking two to three 
years ahead of the here-and-now time frame 
of the practitioner. However, it was ad- 
mitted that it is pretty much of a "guessing 
process" and that ORO probably didn't do a 
good job of touching all bases this way, 
particularly since many of . the informal con- 
tacts and users' Inputs are restricted to 
users at the federal level. 

OPE, in managing the Labor Market Infor- 
mation program, has determined users' needs 
through the "wise judgment" of people who 
work In the program bureaus. However, there 
are plans to develop a more formal design to 
elicit users' needs, and this will be pro- 
posed as part of the FY72-FY75 budget. 



The roles of. the various memoers on 
these "teams'* are being defined for each of 
13 stages in this process (including a 
"uti I Izat ion" stage) . "R&O Special ists" 
in the regional offices are expected to 
have input into this planning process and 
to participate on relevant "teams." Some 
program peopfe felt there were still diffi- 
culties with this system for a variety of 
reasons: It was felt by some that the bureaus 
do not yet have a logical goal structure: 
input of local and state needs is not system- 
atized; some felt that need determination 
was still politically based to sume extent 
since competing demands make rat ion. 1 1 deci- 
sions difficult. 

RUB has informally attempted (o deter- 
mine needs and interests of user groups in 
various ways. In order to develop a mailing 
list to send reports to the staff fur their 
comments and suggestions, the Branch had 
at one time inventoried staff in the Rehabi- 
litation Servi ces Administration (RSA) to 
find out what research areas they were 
Interested In. Input on needs is also 
obtained from RUB's in-house Advisory Commit- 
tee. A major potential source of input on 
state and local needs Is represented by the 
9 RU Specialists. 



fiJMH Mental Health Scrviaea Development Branch 



tions o* centers a*» sources of nted assess- 
ment. More formal need assessment efforts 
bfi>/e been undertaken by the Branch through 
project funding: a project recently has been 
In 1 1 i atitd wh i ch Is designed, in part, to 
inves t (cate ways of monitoring needs for 
new knowledge and of screening for it; one 
phase ot another project is designed to 
survey the problems of community mental 
health centers, a later stage wi I 5 look at 
solutions initiated by other centers. Branch 
staff, as well as staff of other research 
units, also have the responsibility of keep- 
ing abreast of knowledge in their own areas 
of expertise In order to identify "gaps" in 
the knowledge base; however, this function 
has beer performed with unequal success 
given the indication of lack of time to 
keep up with such reading. 

Staff interviewed outside of the Branch 
indicated that there was more reliance on 
researchers in obtaining ideas about specific 
research needs. Peer review panels are 
common to all of the research Divisions. Con- 
ferences were a' common technique cited for 
use In tie research program of the Division 
of Narcotic Addiction and Drug Abuse. To 
obtain input about needs from Division 
personnel, staff from the Offices solicit need 
suggestions from these program people them* 
selves. For example, the OPPE solicits in- 
put from Division and Regional Office staff 
in developing its evaluation contract plans; 
solicitation is performed through meetings 
as well as through requests for reports from 
each Division. 'In undertaking the development 
of various products, the National Clearing- 
>»ouse for Mental Health Information in the 
Office of Cormiuni cat tons also solicits 
01 V I s ion- 1 evel need inputs through personal 
contacts and meetings. 

There is no indication that such need 
assessment efforts and their results are 
relayed from one part of the Institute to 
other parts. 



Oi: National Center for Educational 
Cofffftuni cation * 



agencies tu enter into need assessment and 
problem definition activities of the clients 
in their assigned tarqet populations. The 
agents will work closely with people at the 
local level in their areas of need in addi- 
tion to helpinq the local educators define 
their needs. The agents will be asked to 
summarize the kinds of questions beinq 
asked and the kinds of people asking questions 
and Co feed this information back to developer 
In the Labs and R&D centers. No such linkage 
exists as yet, however. 

Within the Division of Communication 
Systems of NCEC, one respondent felt that 
although it was important to get user need 
inputs in developing products and an Infor- 
mation system for practitioners, they were 
not getting this input presently. He didn't 
think that they were getting the right kind 
of Inputs or suggestions that would be helpful 
in covering the right kind of literature and 
developing the right kind of products and 
system. Periodically, at various meetings 
and conferences, they get "hints" of sugges- 
tions and criticism, but these hints were 
felt to come from individuals who do not 
represent the locals they are trying to 
reach. ZR\C staff hope to tie in closely with 
the extension agent system since the Input 
from the agents on the needs of practitioners 
may enable them to develop more relevant plans 
of action. 

A file partition study in ERIC is being 
conducted by the Systems Development Corpora- 
tion to evaluate user needs and to develop 
alternatives to jthe^ present file partitions 
so that the filefs can be divided up in a way 
that will be more useful to practitioners. 
ER IC s taf f members occas I ona 1 ly make s i te 
visits to some of the local and state Infor- 
mation centers to find out what some of the 
local problems are; however, as the Informa- 
tion centers arc just getting started, people 
generally ask what ERIC has that the centers 
can use rather than telling the. ERIC staff 
what they nefid. 

The Eciuc.it inn. >l Reference Center (tRC) 
cuntr.iitt'd ,i study i)n QUERY* users; hnwovcr, 
it Wtis (elt th.1t thftif h.is been no clear pay- 
off ftfiiu thi% study as the contractor did not 
supply K'sulls on who uses the system, what 
user pro!) I ruts aie, and how the system can 
be Improved. The Educational Materials Center 



*A software program that allows for batch 
searching. 
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Various ORD and OPE staff prepare papers 
and budget documents which rpay be a source of 
linkage to pol lcy*makers . Letters ate also 
sent from ASPER to ORO level people in 
order to get i n format ion^ from t^e staff. 
There was some difficulty expressed amonQ ^ 
ORO staff in obtaining information about ^ 
policy need*' and issues of policy-maker*.. 
ORD staff view OPT and ASPER as addlrlon.il 
channc Is tor I r^nsmi ss i on to pul i cy-maki' rs , 
although such channels have not been far" 
mall/ed. A staff member of the Division h.is 
been assignr'd to improve links with OPE » which 
cuuld fcsull in clearer transmission of policy 
needs . > 



Although not the direct respoos ib» 11 ty 
of RUB, bureau needs are' transml tted by 
means of the yearly RSO Strategy to various 
policy milkers » including the Office of 
the Secretary and the National Advisory 
Council for Vocational Rehabilitation. 
Through their reactions and recommcndai tons 
at the time of these reviews, the agency 
also obtains input as to the perce i vcd needs 
of such policy makers. 



ERIC 
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Although no unit in NIMH hasf-^^le respon- 
slbliity for this transmission to poMcy ^ 
inak«rs, there was some evidence that trans- 
missions do occur. Two means of transmission 
ln<llcated Include the use of Infonwl , In- 
house adv/lsory" committees, composed of 
professionals, from various units In NIMH, 
and the use of outsldf groups of reseerchers. 
An example of the former 1^ the ad hoc 
cofmlttee formed in Nif4H to review the area 
of children's mental health. An examplcof 
the latter js the case In which a group of 
outside researchers was convened about two 
years ago to produce a report on the effects 
of television violence on children; in this 
report, the researchers were directed to 
determine What research had been done tn 
this area as well as what research needed 
to be dope. It was reported that Individuals 
In some of -the Offices, e.g., OPPE , occaslorwl- 
ly are requested to prepare brief reports to 
Congress and other policy makers ^on research 
needs/ 



OE nationul C&nh:y^ for ^duqational 
et ormuniaaH ^»"; / 
f 

located in the lobby of the OE building, Is an 
educational Ubrary that plares emphasis on 
exhibits of OE priorities. A needs assess- 
ment study of visitors to the Center has 
been contracted to. the Clearinghouse on 
Library Science. The contract Is desigrad 
to test user reactions to the displays and to 
assess the needsof the display visitors. 

In the future, BESE staff will be aslclng 
abou^t needs at the student level (e.g. » what 
are their problems, their reading levels) 
rather than at the level of the* sghoot de- 
partment where Qeeds are discussed Yn terms 
of how many new buildings or teachers' are ' 
needed.. It Is sometimes asserted that the 
responsibility for determining user needs 
belongs to t-he stal^ "The only thing we' 
do in this regard is to Influ^ce the states ^ 
to define their own needs." Determining 
the needs of the states themselves was not 
felt to be the Bureac/|s business either, but 
rather the^Job of NCEC since th^y provide 
the Information In storage systems. The 
respondent felt that NCEC did this needs 
assessment by "osmosis" at the present time. 
In the Division of State Agency Cooperation 
of BESE, user needs are determfned through 
the state management review process ♦(SMR) 
'^because their client group is so small, 
they can assess needs on a person basis; they 
come to us, we call, etc.'* 



At the Ibost general policy level, the 
Input of needs in planning for NCEC Is on 
the lines building strategies.. One 
respondent felt that It was, "what icinds of 
■ things are going to'click with HEW planners 
and 0H8." By attending various meetings, 
staff can "sense" whether there Is adamant 
opposition, apathy, or approval for an Idea. 

There have been meetings with p-^l Icy 
people to get help on specific programs, and 
there Is a system whereby priority areas'* 
are Identified. However, 1 t was fe)t that- 
an adequate mechanism for need input to 
oollcy makers was lacking. The Information 
:hat tho extension agents will be collecting 
was not felt to be. tl\e ,klnd of Information on 
needs that could be sent to policy makers. 

At the Deputy Commissioner's level In 
the Bureau ctf Higher Education, monthly' 
meetings are held with the major educational 
asioclations^ to discuss the problems and 
concerns of the participants. 
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2.60 Trinsmi tt t ng User 
Needs to the K&D 

Cofltwuni ty 

The maximal system has 
• means of transmitting 
naa^d messages from users lo 
rasaarchars and developers. 
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» f % » 1 1 es ' r.t o P ro- 
Qrji^s for >p*on ring 



nany ORO raM*rch projactt are funded 
becau»« Xhmi /it fairly specific operational 
or policy needs of the HanpOMei- Administra- 
tion. However, the desires and needs of 
prestigious researchers historically have 
been a major influence on the direction of 
the research progracn. Nevertheless, by 
encouraging face-to'face encounters of 
researchers and their various practice and 
policy audiences, the ORO staff promote 
the commun Icat Ion of needs as well as solu- 
tions. A good example Is the "New Manpower 
Researchers" conference sponsored by DOL 
whfch enables new researchers to learn the 
priorities and nedds of tha agency. 



Vlt^ln ORO, the Division \% only one 
contributor to this process, and major 
respon<i ibi 1 Iiy does not rest with ORO alone. 
Rather, this transformation appears to occur 
dt different Irvels, with the different levels 
Involved al various points In the process. 
At the Icv^l of Assistant Secretaries and 
Under decretory of Labor, carrmlttee mretlngs 
ar** held to lde^ff!fy Important flscnl issues 
for DOL. ASPER staff are also involved in 
pr\iit\\y Jetormlmit Ion and Idem I f 1 cdl I on of 
nrea^ of concern. The transformation itself 
*p|»r*fs to be iUir\r nt the ORD lovcl. Scan- 
nifiQ of proposals for research projects !»• 
done hy OPEK st/iff lo evaluate relevance of 
proposed protects to Hanpowar priorities and 
needs; scanning is also dona by ORO and OPE 
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The increase in in-house directed re~ « 
search specifications with greater use of 
RFP's may serve as a vehicle for trans- 
mission. Research proposals must also tie 
Into one of 4he agency's objectives. A 
more formal procedure recently initiated Is 
the annual "Bidder's Conference." Person^ 
who are Interested in SRS research are not i • 
fied of and invited to this conference 
where the broad rubric of the annual R&O 
Strategy wilt be presented to those in 
attendance. The guidelines for contracts 
are also being published In the Congress 
DaMy jfeurnal. 



The primary mechanism through which 
needs are transformed into programs is the 
recently established Operational Planning 
System (described In 2.^0) whereby bureau 
goals and objectives are identified and 
matched with needed areas of research 
suggested by the "teams." However, tn 
spite of this mechanism some of the program 
people felt that the process has not yet 
faacome "rational"; instead, some viewed 
the present system as a political process, 
with various programs "lobbying" for the 
discretionary "pot" of money. 



H/j'MH Mentut Health . prvic*'tt Development Branch 



One notable mechanism whtch has been 
used by the HHSV lo transmit u^er needs 
to researchers has been the heavy invest" 
ment of staff time in consultation with 
potential grant applicants. Branch 
staff not only have assisted applicants (n 
the development of proposals, but also have 
provided inforindtlon regarding priority re- 
search areas of the Branch. One staff member, 
in fact, has conducted in'^house studies on the 
primary decision determinants used by their 
revleV»^nel in selecting projects for 
f undi ng^N;cs-»J ts of such studies are relayed ' 
by the Branch staff to potential applicants. 

Stuff interviewed In other portions of 
NIHH also cited the use of consultation to 
relay their respective research priorities; 
however, the extent to which priorities are 
set by inside staff varies, and user needs 
in some instances meaffs needs established 
by other researchers. One respondent In* 
dicated that most of the exchjinge that their 
staff has with those outside of NIHH re- 
garding the needs of research programs comes 
f rom the researchers, and that tht "re- 
searchers are the ones viho benefit." 



The "continuing objectives'* of the HHSV 
corresp&nd Jjj the r>rogrdm areas which were 
developed f'Kr^ugh '. taff plonnlng at the In- 
ception of the Brandt in \^)0. In turn, these 
program are.ii serve as the focal point lo 
which research is directed and encouraged. 
There was sumo Indication that the operation- 
alization of need priorities into R&O programs 
is not as specific in other research units of 
NIHH. Although some units, such as Centers 
in the Division of Special Mental He^ilth 
Programs, have attempted to define general 
priority or program areas around which to 
build their research and training efforts, 
the transformation from need pj^loriries into 
programs ha^ not been made explicit. 



o 
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Although no formal means to llnit up th© 
needs assessment of the states to other 
parts of OE spch as NIE were cited, it was 
reported that KCEC is trying to build feed- 
bacit to NIE based' on need inputs from the 
extension agent system. As the extension 
agent would first looic at the specific 
j^roblems of the client and then bring tlie 
information^ to him, it Is hoped that this 
system will allow for feedback to the R&D 
community on the research Information that 
is received by the client. Additionally, 
the Renewal Sites project includes plans to 
worl( closely with NIE on a feedback loop 
in its future operations. However, one non- 
HCEC respondent felt that with the new 
legislation, Congressional intent was to make 
sure that OE and NIE don't have a relationship. 
Hence, it may be that practitioner-user need 
Input to researchers via OE will be even more 
problematic In the future. 

Presently, there is no feedback from 
publishers to NCERD and other producers, al- 
though the Offipe of Program Planning and 
Evaluation {OPPE) has been requested to fund 
a project to look si comments and feedback 
from pub I Ishers . 

In the Bureau of Higher Education, 
program guidelines are sent out on applica- 
tions to any potential applicant and, at 
that time, the Bureau Indicates their priori* 
tios. In the Applied Research Branch of 
NCERD, little stimulation of research Is done 
due to lack of funds, and the fact that their 
reiaarch program Is' an unKollcltad one. 



In the* Hnnnqement by Objectives (M60) 
procedure, spnc 1 1 U pioqr.im objectives are 
stiitnri ill the beqlnninii ol etich year .ind 
Ate put Inljj afflict throiiqh .in operational 
plan; this pinn Is thon monitored through- 
out the year. Thos^cvo I uf monitoring de- 
pends upon the priority of the program with- 
in OE dnd HEW. For ex/iinple, working with 
the disadvantaged is .in OE priority; there- 
fore, Bureaus' report their achievements in ^ 
(his .irra and these rnports are consolidated 
.11 the Commissioner's leveT, which in turn 
repnrls to HEW. One non-NCEC respondent felt 
that HBO hindered i nnovdt i veness In OE.In 
that units will set down objectives that they 
can meet: "tf thay developed objectives 
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Statenents ard Re-* 
searchable Questions 

The maxrmal system hd^ 
a capability of defining 
and redefining n^eds as 
solvable problems {diagno- 
sis) and of setting achiev- 
able objectives for change. 
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staff. However, it is not clear how the 
various Inputs are coordinated and systematized 
in this transformation. There Is probably 
room for confusion and error. 



SBS Heeearch Utilization Branch 



Again, major responsibility for this 
lies elsewhere in ORD. The staff at the ORD 
level develop both one-year plans and longer- 
term plans. However, priorities and needs 
are operational ized and developed Into 
specifics In the yearly R&D plan. Those 
Divisions responsible for R&D programs with- 
in ORD also have some Input In operat ional I zi ng 
the needs. There were difficulties expressed 
in developing the one-year plans in specifics 
due to "unknown variables," e.g., timing of 
contracts and<gett(ng researchers to under- 
take the desired projects. Thus, occasionally 
the decisions as to final funding are made 
on the basis of which proposals havr been 
developed Into contracts. I.e.. on a "first 
come, first serve" hasis, which may "skew" 
the R&D program to some extent. 
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OB Nattf^nal Center j'or h'duaaticruil 
Cortnunioation 



that w«ra difficult to achieve and were not 
achieved, It would mean the axe." In con- 
trast, NCEC staff members felt that the HBO 
procedure was both a very effective too) 
for planning and a framework for need sensing 
t nput . 

In planning for particular activities, 
•.g., what targetted connunicat Ions, Clearing- 
house reviews, or clusters of projects to 
sponsor, NCEC draws on policy statements of 
OE and HEW. These priorities are supposed to 
be based on a "total, national view" of 
the problems and Issues. 

In NCEC, each of the projects that the 
various Branches work with has specified 
objectives; money Is given to a project with 
a specific end In mind. The Divisions are 
"misslon-orlented," so there are very few 
unsolicited projects that they fi^nd. In each 
Targettad Connunlcat ion propos'^l that Is 
funded, there is a requlremeri that the 
researcher must have input from the -audience 
for which the project Is prei^ared; this In- 
put has to be in the design of the project 
to assure that the project will meet the needs 
of the audience that the proposer selects. 



Based on the ft&D program areas establish- 
ed in HHSV, staff nenbers have the responsi- 
bility of "stimulating" research In their 
particular area. However, the influence of 
the Branch staff on the development of speci- 
fic research problems to be studied Is 
Indirect, Involvlng'col laboratlon between 
the potential researcher, the staff, and 
the review panel which makes the final deci- 
sion about project design. 



NCEC has no special process for doing this 
apart from its general program planning efforts. 



ERIC 
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Hcxximal DSU Syaten. 

The maximal D&U systet> 
) saves most solution build- 
ing activities to other 
agencies with three excep' 
tlons: 

3. 10 It Influences R&D to 
be More Relevant to 
User Needs 
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Before a project Hs fundsd, relevancy Is 
stressed In two ways: I) ORD sends proposals 
to various people for review, Including 
Division staff, other ORD staff and outsiders; 
2) increasing use is being made of the Request 
for Proposal (RFP) procedure. In which pro- 
posed R&D will fit more closely Into opera- 
tional i zed needs. It was fe)t that relating 
projects to reaT needs Is a part of tjhe 
definition of ''good'* R&D, and that project 
officers generally do "prod" contractors to 
do so. 

After it Is determined that a project 
will be funded tn ORO, the Division does raise 
the questions from the beginning of what are 
the potential audiences and the utilization 
possibilities of projects. This is done 
primarily through the "buddy system*^ for a 
grcMlng number of projects, with project 
officers and sometimes users Involved In 
determining what the users will want from 
the project. Meetings between researchers 
and users and staff are encouraged also. 
The Division decides when final reports 
should be printed In large quantities; since 
this may be important to the researchers, 
the selectivity of the Division could In- 
directly Influence R(D. 
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RUB has developed "Instructions" for 
grantees to include uttlizatton requirements 
in their research proposals. New forms 
developed by RUB are Qpw in use that require 
the researcher to Include in his proposal 
the Idea that there will be an expected 
product or products as well as defining 
specific users for such products. A form 
including RU requirements for continuation 
requests has also been Instituted. Hereto- 
fore RUB'S Influence had existed only at 
the later. stages of projects » I.e., In re- 
port writing, etc. A plan still exists to 
have RUB revl«w all bids on RfP's coming 
out of ORD« but with the limited number of 
staff to carry out this task, this plan has 
not yet b«come operational. 

In the larger organization, there has 
been a trend toward a more In-house directeo 
research program, with the agency "calling 
the shots." This move has been intended 
to make research more relevant to program 
needs » particularly s 1 nee -bureaus are to 
be included In the execution of projects 
in a nuihber of ways: In defining issues 
and problems that require research; In 
developing the guidelines for each project; 
In selecting the grantees; with bureau con- 
currence required to continue or terminate 
a project. There hav« been complaints that 
research Information has not been relevant to 
the operating procedures of the bureaus. 
Originally the bureaus administered their 
own research programs. 

The Office of the Secretary of HEW has 
also onoved to make the R(D of SRS more 
relevant to user needs. Last year, funds 
were withheld for a time on an Individual 
project basis because It was felt that re- 
search proposals In the overall R&D Strate^^ 
should fit better Into specific objectives 
designated by those in the agency. 

The Division of Aging has atterr^ted 
to influence the direction of research pro- 
duced. This Division has sponsored a pro- 
ject In which a manual was developed for 
researchers on how to make research more 
ut II liable. A grant was also given to the 
Institute for Community Studies at Kansas 
City to conduct workshops and a conference 
for researchers In the area of gerontology 
with the purpose of "sensitizing" them to 
the necessity for utilization of their 
research. 
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The second phase of the HHSV*s R&O 
mission includes **the development of appro- 
priate solutions through research.'* Thus 
Branch staff members, in consultation with 
potent fal applicants, encourage researchers 
to develop proposals that will fit into 
Branch (and Olvls(on) priorities. Even with 
this noted move In the Branch toward "colla- 
borative" R&O with heavy Input from staff 
in the pre-funding stage, final review' rests 
with the outside review panel. However, 
staff noted that the review pane) has cooper- 
ated by reviewing proposals In light of 
Branch priorities. In an earlier project 
sponsored by the Branch on factors In- 
fluencing the success of research, a list 
of criteria (e.g., relevance, receptivity 
of researcher to consultation, etc.) was 
developed by which to judge the potential 
of research applications. These criteria 
are now used by the review panel In making 
funding decisions. 

The HHSV has not attempted to Influence 
other R(0 progrfms In NIHH, although it was 
admitted that the monitoring tnat they do 
and the Input that they obtain could have 
some relevance for the other applied re- 
search programs. The staff in the other 
units cited informal attempts (through con- 
sultation, discussions at conferences and 
meetings, etc.) to influence research, al- 
though there was some mention of difficulties 
in getting researchers to develop proposals 
in some areas where there are known needs. 
These difficulties may be due to the lack of 
researcher interest In the areas and the 
lack of "researchabi 1 1 ty'* of the problem. 



In NCEC, the project officers are 
supposed to provide developmental assistance 
to the projects. The close contact with 
contractors and grantees In terms of moni- 
toring goes beyond Insuring the compliance 
of projects with the objectives stated In 
the grant documents and Includes providing 
"technical advice" to project directors. 
Program work, I.e., the development of new 
program areas, was cited as an activity by 
several respondents. The stages Involved 
in this process Include discussions with 
other Branch staff, program descriptions 
and specifications, RFP's for contracts, 
outside reviews of proposals, selection of 
projects by staff, and negotiations with 
proposers to make, projects more likely to 
be successfu I . 

One of the objectives of the extension 
agent system Is that as the extension agents 
work to Install Innovations produced by OE 
or OE-funded projects, a feedback loop will 
be established between the Installing agency 
and the producing agency. This mechanism. 
If It can be estabMshed, should allow the 
agents and the retrieval centers to feed 
back Information about the holes In their 
knowledge base. 

Although NCEC has no formal Influence 
Over the bulk of the OE R&D program (until 
1972 in NCERO, now tn NIE), some respondents 
felt that there was a "close and very pro- 
ductive relationship" because of the origins 
of NCEC within the Bureau of Research and 
the resulting historical ties among the two 
staffs. 

ERIC and Its Clearinghouses were seen 
as having some influence on the research 
of OE through their syntheses and reviews 
and even through their selection process 
for reports to include In ERIC; however. It 
was felt that this Influence was over a long 
time period. One respondent felt that KCEC 
should not be over Involved In the research 
program (development* settinq priorities, 
•valuation, etc.) because they were experts 
In communication and O&U, not in the substantive 
areas of research > Instead, according to this 
respondent, NCEC should take the products of 
research and decide the best way to disseminate 
them and which audiences could use the pro- 
ducts. 
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3.20 It tnflue'nccs K&D Out- 
Fut to be Hore Pis- . 
semi nab I e and Us<5Te 
by Kay Target Groups 



ERIC 



H,A, Divieion of RiD UtiliMation 



The division has much Influence in this 
activity through a number of means. Some" 
times Division staff are asked to review 
research proposals on the basis of their 
"accumulated base of knowledge on D^U.** This 
is accdnpllshed through the "buddy system** 
for a nufi4)er of projects: the Division staff 
make suggestions as to how drafts of reports 
should be writtan, intervene In discussion 
of drafts for final reports » and discuss 
with project officers what products should 
be developed out of the projects as well 
as how the products should be disseminated. 
A good example of developing a project into 
a usable tool can be cited: The University 
of Houston wrote a detailed report of Its 
experiences In developing a Center fn the 
Universfty to serve connunity manpower needs; 
at the prodding of Division staff, they 
distilled the pertinent experiences and 
produced '*guidel Inot" for oth«r uni^rsitles. 
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SRS R^searah Utilisation Branch 



RUB has had some Influence on the R&D 
output, particularly on that of the rehabiU- 
tat ion research program. This influence has 
been largely through the^ guide 1 ines th«y 
have developed for final report writing. 
Raqulrements In these guidelines Include 
Items such as a short summary for each re- 
port, distribution to each of the state 
agencies, etc« Presently an RUB staff rneffl** 
ber Is heading a Task Force which will re- 
vise the Guide In an attempt to develop 
requirements for all SRS R&D programs. 
There Is also RU Input In the development 
of continuation requests, since written 
instructions require that researchers must 
address themselves to RU. 



NIMH Mental Health Services Devtlopmnt Braru^ 



The HHSV has employed several means to 
influence their R&O output to be more usable. 
In thel' consultation woric with researchers 
in the pre*funding stage. Branch staff stress 
the Importance of utillzable results, espe- 
cially since the Branch has relied heavily 
on researchers to participate tn D&U acti- 
vities. The Branch also has begun to use 
D&U supplements for some grants to assure 
disseminabM I ty of projects; supplements 
are used for such things as' conferences and 
^'action consultant" services. One other 
way to stress to researchers the Importance 
of such results has been the monitoring 
activities conducted by the Branch: upon 
completion of each project, the quality of 
incoming reports is measured In terms of 
cogency, clarity, and usefulness; researchers 
are as}m& to cite what persons or groups have 
begun js i ng projecM resul Cs as well as how 
'^any 4 i s >emi nat ionR have occurred. Other 
'e^earch units have expressed interest in 
t*^€ Brar^th's monjtorin9 techniques, although 
it is not known whether these other units 
have adopted this method. The criteria used 
by the review panel in evaluating proposals 
,a)so include iten^ which would influence the 
utility of projects: innovat i veness , coherence, 
awareness of the need for dissemination, and 
utilization planning. 

in other research units within NIHH 
there was an Indication of varying degrees 
of (nterest In making research usable. \n 
thr Center for Studfe*i nf Crime and Delln- 
•lu^ncy. adml nl n r rat Ive D^U «upplemnntii have 
Ummn \i%mt\ In tt T pw cn%»% to pricouraor ihr 
• t hn in jiii>rliii« Uft^iij* lcl^lJll^. On 

liip tiihcif tmnil^ ntunm uri I I % wh I < li •t|irii)<\rH imiri* 
hanit i«%«.iMh (all tUmi Ihl^ 1(1 nci of 1 
fliicihiti »%uulil nut ti» pii»-. Milr, siMce |»ra- 
ilUlWutut appncabntty is dUflcuU in 
Ic typr^t (if research which are funded. 



OE National Center for Educational 
Cortrmtnioation 



Even in unsolicited research programs 
within OE, there are guidelines fJeveloped 
that researchers must incorporate Into their 
proposals; these guidelines include questions 
on the users, the end product, and the signi* 
flcance of the project. However, these guide- 
lints were not felt to be stressed as much 
a^ they should be and ware not specific for 
particular research prograns. 



One of the stages tn the development of 
new program areas involves negotiation with 
the proposer to malie the project more likely 
to be successful. Contacts with researchers 
may occur on particular projects in terms 
of monitoring and reviewing duties. For 
example, NCEC staff monitored an Educational 
Testing Service (ETS) project that was de- 
signed to evaluate products developed by 
the Labs and R&D centers and to recommend 
which ones would be most effective. 

One non-NCEC staff person cited as 
the biggest shift In OE the Increasing im- 
portance of quantification and documentation 
{and success) of programs and also an In- 
creased importance of program planning (HBO). 

The Bureau for the Education of the 
Handicapped Is planning a contract for the 
development of an institution called a 
"Katlonal Center" which will looic at all 
products developed under the auspices of 
the Bureau. The Center will decide which 
products should get a "push." 



o 

ERLC 
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3.30 



It Conducts R&O on 
th% DtU Process 



M,A, Division of HSD Utilisation 



The Division has initiated various types 
of projects: attempts to target comrtunlcation ( 
for special audiences, ESD to explore new 
programs, work on conceptualizing thi» Icnow- 
ledge flow procei^s, (e.g., through conducting 
conferences Vnvo\ving outside experts in 
Che field), and projects to repackage in- 
formation. In general. It appears that .more 
of the R&D initiated by the Division attempts 
to actually improve dissemination and use of 
Knowledge rather than to investigate the 
D(U process itself. Exceptions include*^ Che 
present exploratory case studies, a literature 
search on utilization theory being under- 
taken In the Manpower Science Services project, 
and the I966 Glaser study which was intended 
to develop'a ^'doctrine" of utilization for 
the Manpower Adiatnlstratlon. 



SRS Reaearoh Utilisation Branch 



Host projects sponsored by RUB to 
date have been designed to produce pro- 
ducts, conferences, or new roies in the 
cormunicat Ion network (the RU Specialists). 
However, an early study done in \S6U attempted 
to investigate methods to facUitate the 
utilization of rehabl : ; lot ion research re- 
sults. An evaluation study of the RU Special- 
ists Is planned which wlH investigate a 
portion of this D(U process. Other pro- 
jects have been proposed by RUB which are 
designed to improve the process of dissemin- 
ation and utilization. 
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OS National Center for Educational 
Cormtunication * 



About 1% * B% of the Branch S funds have 
been used for projects on the process of D&U. 
Such projects have included studies on hoM 
to bring about program change, how to make 
research n»re utilizable, and how practitioners 
utilize Information, These projects have 
had effects on the operation of the Branch. 
For example* the criteria used by the review 
pane) were developed in a Branch funded pro- 
ject. The behavioral change model which the 
6ranch Chief has recently adopted for use 
came from earlier work sponsored by the 
Branch. Projects underway now are designed 
to enhance the Branch's R&D mission. One 
project begun recently Includes several 
phases which will test various products and 
techniques to improve D&U activities and will 
have a training phase In which Branch staff 
will develop consultation skills for pro- 
n)ot)ng change. The projects which are 
designed to produce "products" usually are 
funded by contract money or by administra- 
tive supplements. There has been sotne diffi- 
culty! however, in obtaining funds for re- 
search on the 0£U process as well as for 
DSU projects. Instead, most of the Branch's 
funds are used for research on substantive 
areas* e.g., new services to schizophrenics.' 
Reasons 'or this allocation include the 
fact that research on service problems is 
more Ukely to have visible impatt and the 
desire for immediacv of returns on the part 
of those who make funding decisions. 

A few evaluation contracts have been 
directed to look at portions of the D&U 
process. A contract administered jointly 
by the OPPE and the Division of Extramural 
Research Is designed to trace the applica- 
tions of basic research flndinigs over a 30 
year period. It Is hoped that this tracer 
study will provide some Insight Into the 
process of "bridging the gap" between basic 
and applied research efforts. Although 
the Office of Communications contains some 
experts in the area of cormtunication and 
Information science, no research on communi- 
cation has been sponsored by this unit. How- 
ever, the Clearinghouse fn this Office Is 
considering the posslbinty of funding this 
type of "process" research beyond the pro- 
ducts lh<7y are having developed presently. 



AppUed R&D In the area of D&U is one 
of the five specified objectives of NCEC. 
NCEC both produces' and uses research on D&U 
in developing their own programs. To survey 
the D&U knowledge base, they have used ERIC, 
the £RC DIALOCi system, consultants, Ideas 
derived from research, commissioned studies, 
etc. There are about 120 dr:uments In the 
ERIC file that relate directly to the con- 
cept of linkage In D6U programs or on exten- 
sion agents. Huch of this material has 
been generated from NCEC-sponsored projects. 

Within NCEC, support of applied R&D in 
the field of dissemination is the' des Ignated 
mission of the Extension Support Branch. 
Research on communication methods is de- 
signed to find out "what goes on out there" 
regarding innovation and adoption and to 
improve dissemination practices. Examples 
of activities of this type Include a study 
In which types of federally-produced voca- 
tional education "packages" are compared 
for possible dissemination to school systems, 
a project which deals with some review and 
reconceptual Izat ion of dissemination, and 
a project that is viewing innovations from 
the superintendent's point of view (In a 
sense, this latter project will test the 
linkage model and other models). 
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Function Set Mr 
SOLUTION PROCESSING 



Mcaeiirkil DdU Syetem 



4.10 Kn owledge T rans forma- 
ttons 

The raw R&D product is 
simply unpalatable for most 
users, it is too long and 
wordy, filled with statis* 
tics, written .in the spec- 
ialized language of the 
researcher's field, and 
often addressed to the con- 
cerns of other researchers. 
The maximal D&U system can 
take the raw product and 
transform it in innumerable 
^ways., condensing, repaclca- 
ling* simplifying, summariz- 
iisg, combining and so forth. 
ToXsome extent, reaching 
different audiences requires 
different types of trans- 
forma rl on. 

An YjTiportant type of 
transformation is the trans^ 
fer of a message from one 
medium to anbther . In the 
maximal OSU system, messages 
are constantly being trans- 
ferred from writing to 
speaking (via reading) and 
f rom speak 1 ng to wV^I t i ng 
(via documentation ^nd tran- 
scribing). Host successful 
transfers from source to 
user are, in tact, trans- 
formations as well as trans- 
missions because in the pro- 
cess of listening, reading, 
remembering, and incorpor- 
ating new knowledge into 
his behavior, the user in- 
evitably makes changes in 
what he receives, adding 
from his own experience, 
from ptf\er things read or 
heard, sirapUfying, level- 
ling, sharpening, etc. 

Hore sped f ical ly , the 
maximal DSU system must be 
abla to make the following 
types of transformations: 



M.A. iHvieion of RSD UtiliMmtion 



Much of the energy of the Division's 
staff goes Into transformation activities of 
one sort or another and It Is probably- in this 
area that the agency Is strongest* Much of 
the transformation work is carried on within' 
the agen^^v^athar than being contracted to 
outside sncUllsts. - 



—Sii^€8eapeh VtiHzation Branoh 



f<UB has done much to transform RSD re- 
ports Into readable and usable products 
although the philosophy of the Branch Chief 
has been that some of these efforts should 
be the responsibility of researchers, R&D 
Centers, and Research Institutes themselves 
RUB^s Ideal role would be more that of a 
catalyst for transformations rather than a 
transformer. 
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HIMH Wtont^Z /health Servioee Development Bvarush 



The HHSV has not concentrated its re- 
sources in this area of activities.* Trad!- 
tionaliy, the Branch has operated under the 
assu;npti^n that researchers should be the 
primary proponents of DSU activities and 
the Branch has encouraged researchers in 
this area. One of the reasons for this 
assumption has been the lack of resources 
for this type of activity: only a small con- 
tract budget Is available to have products 
developed. Hence, there Is a trade-off in 
grant allocations between research on sub" 
stantive problems and research to Improve 
06U act! /I ties. 

Oth^sr research units Mithfn NIMH hav« 
cited sinilar problems in funding various 
transfomat ion activities, with the same 
lype cf rade-off in existence. As one out- 
side respondent stated, "There's a lot of 
lip serv ce paid to 0(U, but when it comes 
down CO doing it, people aren't willing to 
pay for t.'* 

The exception, however, is in the Offices, 
wh«!re bo'zh staff time and contracted work 
to outsiders are heavily invested In the 
area of r.ransformat Ions , The Clearinghouse 
in the Office of .Xommunlcatlons , for example, 
has devoted most <^f its efforts to packaging 
and dissemlnatloniactivl ties. 



ons , has been 
however. 



*Thfi n»w MHlV magajtlno, Innovif' 
d«^lgned dk m t rant format Ion device 
It wa% not produced until several months 
following the dato^gatherlng for this case 
study. A second magazine. Evaluat Ion , has 
a similar purpose; It Is being produced 
through grant funds. 



OE Haticmal Center for Educational 
Cnnrmnioation 



The Dissemination. Programs Branch of 
NCEC is concerned with the use of various 
medlat printed materials, travel Ing exhi- 
bits that take Information to people, and 
special kinds of workshops that focus on 
finding things out about innovations and 
better practices. One respondent said that 
In "pushing" educational Innovations or 
products > they fund demonstrations, develop 
products, and train people to use products. 
In the Clearinghouses, ERfC has taken some 
measures to dictate the kinds of products 
to be produced; for example, the Clearinghouses 
have been instructed to decrease the nunVber 
of bibliographies produced and to Increase 
"the nurrtber of other products. The Copyright 
Program of OE is unique to that agency in 
that no other federal agency has as compre- 
hensive or as centralized a program. This 
uniqueness was attributed to the fact that 
OE supports the development of materials 
for a mass market In which a particular I tern 
might sell for $1000 or more. 
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Haxinal DiU Syetm 



k.W Production of 6asic 
. Written Haterlal 

The most fundamental 
sort of transformation of 
concern to a p(U system Is 
the transformation of raw 
data and ejcperience Into 
written products* .e.g. * re- 
search reports, case studies* 
histories » documentations, 
etc. The maximal OSU sys- 
tem should be able to take 
much of this for granted as 
'* Input" to Its operations, 
but it also has to have the 
capablJJty of retrieving 
and documenting Important 
events such as demonstra- 
tions, conferences, and 
development project histor- 
ies. The maximal D&U system 
should also have the capa- 
bility of documenting its 
Gwn history and Its own 
activities. 



^1.12 Summarizing (Including 
Abridging, Abstract I ng, 
Annotat Ing) 

Summaries general )y add 
greatly to the utility of 
documents for any audience. 
They key readers to impor- 
tiftnt contents; thuy make the 
task of synthesis easier and 
they reduce the Input toad 
of busy users for whom «| I 
contents are not necessary 
or relevant. Summaries are 
normally far easier to trans- 
~'mlt and to ramember than 
total contantf. 



M,A. Oiviaion^f BSD Utilization 



Host research sponsored by ORD Is con- 
tracted to outside researchers. Some ORD 
staff, particularly In the Research Division, 
are responsible for doing research from 
secondary sources, although ORD does not 
have the resources to undertake original 
research. Reports are required from all con- 
tracts and grants. 

The Division's various activities were 
at one time documented by an in-house his- 
torian, but this practice has lapsed. In- 
formal memoranda on the Utilization Division's 
activities and plans are still prepared from 
time to time, and the earlier practice Is 
being re-established. 



The Division routinely summarlzee or 
contracts for summaries of a-1 1 contract and 
grant reports. A significant amount of this 
Is done )n-house (e.g., the RtD Summaries 
and the annual projects book) , some of the 
rest by authors, and some by contractors 
(e.g., Brookings contract for the WIN 
Conference). It appear^ed that management 
of this abstracting operation could be 
contracted to free up more Internal staff 
time for other matters. 

Abstracts of reports^iare generaUy of 
a standard depth suitable for NTIS listing; 
all research reports are required to con- 
tain not only summaries but aUo conclusions*^ 
and recommendat tons>. 



SFS HeBearoh Utilization Branch 



The Division of Intramural Research In 
7 ORD has had the capability of doing in- 
house research, particularly In the area 
of social welfare. However, decrease in 
staff size has limited such research activity, 
with present emphasis on monitoring contracts 
to outsiders. Final reports, and In some 
cases progress reports i are re<]uired of all 
the R&D programs in ORD, although specifi- 
cations vary. RUB itself is responsible 
for obtaining final reports of the rehabili- 
tation research^ program, artd this task re- 
quires almost full t ime attention by the 
Rasaa rcK Adm i n 1 s t ra t*i ve , As s i s t an t . 

RUB '4 activities and development have . 
baen well documented^ and up.-dated by one 
of the staff members, whose skills In docu- ' 
Plantation have been useful not only to 
Insiders but also to those not so Vamlllar 
with thair activities. 



RUB is monitoring a contract which is 
designed to abstract and index all final 
reports completed up to the present ""over 
1*73$ abstracts have been completed to 
date. Summaries of standard length are 
produced which are appropriate for NTlS 
listing, as well as 1,000 word summaries 
and 200 wor^d abstradts which will go Into 
the computerized information system being 
developed. Also, final reports are re-, 
quired to Include a page of significant 
findings, an abstract, and an R&D Brief , 
The SRS Research volume produced by RUB 
contains an annotated list of all. pro- 
jects, both completed and on-going, spon- 
sored by SR$. This volume will be updated 
annual 1y . ' ^ 



ERIC 



HIMH Met.tal Health Seiificee Development Branah 



>1NSV» aside from documenting and moni- 
toring the use of its research projects , 
has various other means of recording and 
monitoring its activities. Staff have 
been encouraged to keep logs of contacts, 
requests, etc., as we I I as documenting site 
visits to centers, although the latter acti- 
vity has met with unequal success since 
this documentation takes time. The Brdnch 
has adopted a goal attainment scaling techni- 
que (developed In one of their projects for 
locaT centers) by which to assess the Branch's 

V actual proq^ress toward its objectives as 

V compared to expected (or average) progress, 
^**^nd above average progress. Some of the 

Branch's projecfts have been designed to 
document, 'Nhat 's going on in the field" in 
mental health centers and in other types of 
mental health services, and this informa- 
tion will, become a part of their knowledge 
base. 

NIMH has various research units involved 
in intramural research. The whole Division 
of Intramural Research conducts In-house 
research In laboratory and clinical settings. 
The Division of MH Service Programs Itself 
has a Branch, calted the Hental Health Study 
Center, which conducts In-house research on 
' mental health services. 

Requi rcmcnts 'for final reports vary 
across research programs In NIMH, ranging 
t from the final progress reports required in 
parts of the Division of Extramural Research 
to the requirements pf the MHSV which in- 
clude a final repor/ plus a surnnary and 
report of use of project results. 



•Most of this activity is contracted out 
by two of the Offices, and the summaries 
produced are not necessarily limited to 
those of research produced by MIMH. The 
National Clearinghouse for Mental Health 
Information (hereafter caljed the Clearing- 
house) In the Office of Conmunlcatlons Is 
monitoring contracts for the abstracting or^ 
articles from 32$ *'hlgh yield** joufnaU pro- 
duced In various countries as well as from 
2600 journals of "lower yield." In addition, 
books, monographs, techni ca I . reports , work- 
shop and conference proceedings, an^ symposia 
are abstracted under contract. Such abstracts 
are stoVed In their computerized informa- . 
tioo system. The output of the Clearlng- 



OK national Center for educational 
Commnication 



Information in ERIC Is primarily R£D 
based, although recently some Innovative 
practices and programs have also been in- 
cluded. The information^ is derived from 
the fugitive literature searches of the 
Clearinghouses, the screening of 600 plus 
major education journals ( Current Index to 
journals in Education , CIJEJ , plus reports 
from various OE divisions and other agencies. 
Including all research reports. They also 
monitor the collection of the National 
Technical Information Service (NtIS). It 
was felt that the ERIC files did not Include - 
the pract Ice'-oriented literature (research 
or otherwise) developed at the local level, 
nor Is there complete coverage of state- 
developed materials. However, action Is under- 
way to increase these types of materials , 
e.g., a project to collect "promising educa- 
tional practices." There was uncertainty' 
expressed as to how much of the relevant 
information from other programs in OE was 
actually being sent to ERiC and then put 
into the system. Although they do have 
agreements with people In other programs, 
t;he organizations and people change, some 
programs in OE have copyright authority, 
and they are not certain of .all the OE 
programs as they change rapidly. Other 
gaps cited In ERIC coverage include the 
areas of the arts, music, and humanities. 
Different reasons were cited for gaps In 
ERIC coverage of all sources: one NCEC 
respondent felt that the problem' was not one 
of "philosophy," b^ut a shortage of staff 
>o arrange for Input Into ERIC and to moni- 
tor whether they are getting adequate input; 
another staff member felt that a definitive 
pol Icy was 1«ck!ng. 



ERIC administers the Clearinghouse 
contracts (19) and about s~tx other con- 
tracts which deal with collecting, select- 
ing, cataloguing, and indexing of Information 
to be put into their information system. 
ThR documents selected are indexed and ab- 
stracted by the Clearinghouse according to 
a closed vocabular control led language. 
For each selected document, the Clearinghouses 
prepare a 200 word abstract. The knowledge 
base Includes Journals ( C> JE ) as well as 
reports. 



ERIC 



Therefore, the maximal 
Dili system sumnarizes or is 
able to require further 
sufnmarizat too of all dodu- 
mentsand to provide summar- 
ies of varying depths for 
the same docuetent. 



1 



^. 13 Col tection and Syn- 
thesis 



Artother Important type 
of fans format ion for ail 
audiences the gathering 
^nd reviewing of a number 
of Studies from the know- 
ledge tyQse. . Jhis becomes 
more and more cVucia^ as the 
volume of research reports 
and the sire of the Icnow- - 
ledge base Increase. The 
ffl«xlii^a) DSU systcffli is able 
to call upon sldll^d writers 
and synthes iz'ers to put 
together review papers and % 
book's on various topics as 
well as on the entire sub- 
ject domain of the agency. 
TH«ve Syotheiic r»viewv 
•re a* prime Importance to 
the rejearc^'-er an4 to i"' 
lesser extent x^t vslicy 
maker, but they are also an 
important intermediate 
step to the more social ized 
transformati ons j ^crl bed 
beBow »nd^*ffey form an Im- 
portant access Wnk to the 
raswarc/ document bas^ «s 
a who\M 



ERIC ^ 



.A. Divieion of RiV UtilC»ation 



From time to time atteniptsrare made to 
compile compendia, reviews, and .syntheses 
of a number of studies. A major effort of 
this sort was "Operation Retrieval"* which 
analyzed reports and records from 55 E60 
projects In the youth fl^ld. Eight scholars 
(one of whom Is a division chief in ORD) 
developed eight summary papecs publ Ished' as" 
one compendium, Breakthrough for Disadvantaged 
Youth . This product Is gener^T^y viewed as 
one of the "successes" of the Offices, but 
there is no -regular pattern or routine for 
the . product ion of similar reviews In other 
areas.. It should be noted that Breakthrough 
Is not a true synthesis of l^nowledge on a 
manpower topJ-c because' 1 1 restricts Itself 
to» EAD projects and ignores the larger know- . 
ledge^^b^e on manpower generated by research'^ 
project* ^rom ORO or elsewhere. Other 
examples of syntheses of In-house RfcD subject 
areas Include ^'erman's Job Development for 
the Hard to Employ , a synthesis based oh EiD 
projects In the areas of older workers, and 
a synthesis on Industrial Opportunity Centers,'., 



-*Thjs project was begun before the formation 
in 966 of a utilization unJt in the Manpower 
Administration. Publication date was 196$ 



SRS R^eearoh Utilisation Branah 



RUB has, from tlmaf'to time, funded 
projects for reviews o^ the literature i» ' 
specific areas^ Major efforts of this type 
are undertaken by the RRI 's in social wel- 
fare institutes which are established 
around core areas of concern. These Units ' 
.have responsibilities for coUecjion and ' 
synthesis of data on a continual basis; 
some produce up t9 ten syntheses a year. 
Such reviews are then distributed In wJno- 
graph form to about i*,500 users. The, 
Regional Rehabilitation Resjparch Institute 
tRRRl) at th» University of Florida has 
been funded to develop a series of mono- 
graphs which review areas of rehabilitation 
R&D. Two state-of-the-art reviews are 
underway in the areas of ^ rube It a and. psychia- 
tric rehabilitation. The coverage of re- 
•searih areas Is by no means complete .^and 
there Is still a need for an annual review 
covering the other research program areas.,.. 

The Research Analysis and Utilization^ 
Bran ch (RAUB) originaHy performed the 
in -Rouse function of reviewing and collating- 
research on social welfare. RAUB did not 
restrict Its^f to that research produced 
by SRS -and used othe/ aval lable, deposi torles 
to expand their co>eraga«^ 



X 
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house includes not only computer prInt-outs 
of citations and abstracts in response to 
individual requests, but also numerous publl* 
cation^: '1) abstract Journals published 
periodically Include Psychopharmacology 
tostracts and Cr<me and DeWi nquency Abstracts ; 
2) the Schizophrenia BxiMetin is published 
periodically; 3) the Mental Health Digest 
includes siAnmaries of various works. Special* 
lze<l one-time bibliographies (sotnetlmes 
annotated) also are produced through the 
Clearinghouse by contract. Such products, 
including the periodicals, are often done In 
conjunction with the relevant Divisions and 
sometimes with staff from other agencies. 
Tor example, a contract for the production 
of a bibliography and abstracts on the Treat^ 
ment of Al cohol 1 sm is underway and Is being 
monitored coHaboratively between the Clear- 
inghouse and the Division of Alcohol Abuse 
and Alcohol ism. 

The Program Analysis Branch of OPP£ has 
a contract to abstract all project* reports 
produced through evaluation contracts. The 
HFISV requires that researchers produce sum- 
maries of project results, and these sum- 
maries are ^also placed in Che Ctsarlng- 
house information system^ 



The HHSV has sponsored a few contracts 
designed to produce state-of-the-art papers 
around particular program areas that they have 
emphasized. For example, a contract that 
was recently completed produced a compendium 
on children's services in which the literature 
was reviewed over the last three years. Branch 
staff members a.re encouraged to keep up with 
the latest developments in their particular 
program area and occasionally, staff will 
develop state-of-the-art reviews In their 
area of expertise or have these done by con- 
t'ract. 

However, collection and synthesis acti- 
vities are common among other research units In 
NIMH as v^ell as in the Offices. The Center 
for Studies of Crime and Del Inquency has con- 
tracted to have eleven monographs done which 
review the literature around special areas of 
concern; yet one of the problems cit^d was 
the small amount of contract money avail- 
able for this kind of product. Even in the 
more basic research areas, e.g., portions of 
the Division of Extramural Research, confer- 
ences and other workshops have been funded 
to provide a forum for integration and syn- 
thesis of research. 



OE National Center for Educat i ^naL 
Cotmunicaticn 



In their given areas, the ERIC Clear- 
inghouses produce reviews, analyses and 
syntheses, monographs, blbl^psgraphtes, and 
brochures. The Clearinghouses also use' 
their files of requests to develop their 
own products, e<g>t bibliographies based 
on the most requested information. Al- 
though some Clearinghouses publish their 
own material, many have developed arrange- 
ments with others to print the products *^ 
free of charge. Other groups« Including 
other federal agencies, have made arrange- 
ments with the Clearinghouses to acquire, 
select, and Index specific subject areas 
for them related to education. \They have 
had approximately $1.1 million In^sub- 
contracts and grants this year. ^ 

Considered to be at a "higher level" 
than the bibliographies, syntheses or 
state-of-the-art reviews also are created 
by the Clearinghouses. NCEC takes bids 
and issues RFP's for literature syntheses 
in certain problem areas and has funded 
several reviews, e.g., Havelock's PLANNING 
FOR INNOVATION, a comprehensive review of 
literature on dissemination and utilization 
However, one respondent felt that In the 
past even these reviews have been oriented 
toward researchers. Crowell, Collier, and 
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based on 18 EsD projects. However, the 
National Hanpc^er Polity Task Force (MHPTF) , 
under contract with ORO, has produced 
syntheses that extend beyond products of 
ORDt e.g.t a recent survey done on studies 
available regarding status of women In work. 
A major purpose of the Task Force Is to assess 
research in key areas and prepare reports 
on what is known and what more needs to be 
known . 

The Division is a)so sponsoring con- 
tracts for the development of three 
"state-of-the-art" papers in the areas of 
assessment instruments, corrections, and 
worker att i tudes . 

The Manpower Report qf the President 
(an ORD product) is close to being an annual 
compendium of manpower knowledge but does 
notp usually attempt to review the research 
and development literature systematically 
(although this was done for the year IS69). 
There Is still a clear place for an annual 
review of manpower research or research on 
specific manpower topics^ although the 
syntheses of the NMPTF partially fulfill 
this function. 



!iJh& HenUil Health Serviaea Development Branah 



In the Program Analysis and Evaluation 
Branch of OPPE , several "science writers" 
are paid to develop syntheses and reviews of 
specific research areas supported by NIHH; 
output includes such reviews as Sleep and 
Dreams , Urban htental MeaUh , Biologica l 
Rhythms , and Rural Mental HeaUh . ThiT 
Branch Is also responsible for an annual 
Program Report , produced over the last five 
years, which reviews major NIMH prograimiat i c 
efforts Including both research and service 
programs sponsored by NIHH. However, even 
with ihl-s effort, soflw staff members felt 
that nore major reviews were necessary for 
adequate coverage of all of^the areas 
fupported by NIHH. 

The Clearinghouse In the Office of 
Communications has contracted to have 
state-of-the art reviews produced which 
encompass more than Just the research spon- 
sored by NIHH. Some difficulties were cited, 
however. In developing good reviews, as there 
Is always the possibility that the reviews 
will turn into a '^series of abstracts Joined 
together." Occasionally, staff in the 
Director's Office also are called upon to 
develop reviews of problem areas when the 
problem doesn't fit neatly Into any one 
Division's research boundaries. For example, 
a review was requested by the White House on 
what was known about the behavioral conse- 
quences of home property ownership among those 
who have had little property, and the request 
was turned over to ths Director's staff. The 
review that was produced was developed by 
bringing In a group of researchers who were 
knowledgeable in this area. 



OS national Center for i^duoattonal 
Corrrrunioation 



McMillan, [n cooperation with NCEC, has 
created numerous '^spin-off" products such 
as the Cumulative Current tndex to Journals 
in Education for 1966-1969 (another volume 1 s 
being produced for 1969-1971) , a biblio- 
graphy on reading, the publication of the 
ERtC-produced bibliography for the Presi- 
dent's Commission on Finance, and a Cumulat i ve 
index to ERIC . A separate cumulative Index 
to ^Rl C was also done by Prentice-Hall. 



There is a project in NCEC for setting 
up a program to collect information about 
promising educational practices on a national 
basis in collaboration with state agencies. 
Working through the dissemination represen- 
tatives, staff and an outside contractor 
have put together a format for acquiring 
information- "Awareness Level'* bulletins 
are put out by NCEC on such things as 
other models or selected projects (e.g., 
bulletins for some Right-to-Read projects 
which were done with Title \ funds). 

The Educational Materials Center staff 
of NCEC have developed bibliographies which 
they send, free of charge, to people on their 
mailing lists. The bibliographies are de- 
veloped around areas of concern in 0£ and 
are not based on research reports, but rather 
are designed to tabulate an index and annota- 
tion of textbooks for elementary schools. 
Juvenile literature, etc. The Center has 
tried to build up its system of exhibits 
which document exemplary programs. They 
have been requested by the Office of Public 
Affairs (OPA) to distribute two of their 
booklets of a general nature on career 
education and environmental education. 

Yearly, the Bureau of Higher Education 
contracts a series of people to develop a 
publication on trends in post-secondary 
education. However, these state-of-the-art 
reviews have been done as a legislative re- 
quirement and are the only type of publica- 
tion produced. Bureau staff try to utilize 
ERIC materials whenever possible. 

Some things that ERIC used to do and 
that are missed were noted by one OE respon- 
dent outside NCEC, for example: when the 
monthly ERIC abstracts series Research in 
Educat ion (RIE) was started, each Issue con- 
tained a back section listing research 
projects started in the month. The Input 
for this section was derived from an Internal 
document. Cur rent Project Index (CPI) and 
was no longer available when CPI was dis- 
continued. In another such Instance cited, 
Manpower Research , an inventory covering 
research sponsored by a nunnber of agencies, 
was published and ^ald for by ERIC although 
it was a Joint effort of the agencies. How- 
ever, when OE "got tight on money, no one 
else paid for it, and It fell apart." 



ERIC 
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k. \h Tai lori ng 

The maximal D&U system 
is capable of taMorIng 
imporcant research products 
for its most salient aud- 
iences. Such activities as 
editing, rewriting (in the 
language of the receiver), 
reorganizing and reproducing 
may all be part of this pro- 
cess. Hanuals, handbooks, 
and cook books based on re- 
search, but formatted and 
composed to be of direct 
ut i I i ty to persons fn 
various roles, fail into 
this category. The rraximal 
D&U system has at least one 
annual ly updated manual for 
each of Its prime user 
groups (excepting perhaps 
researchers) . 



N.A. Oioiaion of HiD Utilisation 



The Division fs currently very concerned 
about packaging, tailoring and targetting 
R&D findings to specific audiences. 



a) For pol Icy makers : the ORO director, 
as wei I as some stafT In OPE, is partic- 
ularly attuned to findings that might 
have impUcatfons at higher levels. 
Memos and poPtcy statements are typical 
vehicles for such conmunication. Issue 
papers and other papers developed from 
research and other program Information 
are sometimes developed by staff In 
OPE and In the Research Division of 
ORD. Recently the Assistant Secretary 
for Planning, Evaluation, and Research 
(ASPER) Initiated a compendium of 
"Advance Research Briefs"; these are 
summaries targetted for policy relevance 
submitted to the Under Secretary. 



The RUB presently spends much of its 
time in tailoring and targetting i^£D find- 
ings to various audiences: 



a) For pol icy makers : RUB has produced 
several In-house docivnents which have 
relevance for policy makers. There is 
an on-going grant to produce a Handbook 
of Selected SKS R&D Products which will 
highlight those projects with special 
Implications for policy makers and 
other audiences, and will b* distributed 
to various levels. Other in-house acti- 
vities, such as preparing support 
material for budget testimony and pre- 
paring the RUB portion of the R&D 
Strategy* also constitute policy- 
oriented tailoring. In developing 
such papers, RUB has scanned a broader 
universe of research than that produced 
within SRS particularly In the area of 
D&U. Recently » a 20 minute slide and 
tape presentation has been prepared 
for administrators within SRS and at 
other levels of govermient which 
describes the activities and mission 
of the RUB. 

Welfare In Review , a monthly 
Journal which was produced by the 
Division of Intramural Research, con- 
tained research related articles; it 
was Identified as reaching a small 
but important group of policy makers. 
However, this journal has been ter- 
minated and will be replaced by an 
SRS journal called Human Weeds . It 
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As evident. In Section k,]}, numerous 
products have been developed in different 
Divisions and Offices which may have relevance^ 
for a number of different audiences* Yet 
many of these products appear to be organized 
around specif tc research or problem areas 
and not necessarily for specific user groups* 
although such products as reviews, abstracts, 
and bibt lographi es have evident benefits 
for researchers. However » there have been some 
products and other efforts designed with speci- 
fic users In mind: 

a] For pol tr.y inakers : Staff in various 
research units of NIMH are occasionally 
catted upon to prepare special reports 
in their particular area of expertise, 
quick analyses, and budget testimony, 
etc. . to be relayed to policy makers. 
It was noted that HHSV staff can spend 
up to one-'third of their t\mt in 
answering such requests, and the Branch 
Chief, in particular, has been called 
upon to prepare special reports on D&O 
and their mission of R£D. However, 
some units spend a majority of their 
efforts in relaying information to 
pol r cy make rs . Results of the evaluation 
contracts administered by OPPE are re- 
layed to a select group of policy makers 
at various levels by means of a written 
report along with an "executive summary" 
and face sheet which highlight the 
evaljatlon results. One of the major 
responsibilities of the staff of the 
Director of NiMH and those in OPPE has 
been to respond to requests for reports. 



Although it was felt that the field of 
education needs people who are able to glean 
the existing knowledge and Its implicaiions, 
e.g., state-of-the-art reviews, most people 
who attempt to do so were not considered to 
be the most capable, and the best minds in 
the field would be hard to buy. As it Is 
difficult to get researchers to use the 
knowledge base that is available and to build 
on it. one respondent outside of NCEC has 
been thinking of giving researchers funded 
through his Branch about $5000 extra at the 
start of the project to require more sophis- 
ticated reviews before the proposals are 
accepted. 



Although the client base of NCEC Is 
Intended to Include the "entire spectrum of 
education." Jhey provide various forms of 
information to different audie>?ces Both 
ERIC and ERC are used as tools to develop 
a general awareness of the area of D&U. 



a) For pol icy makers ; An effort is 
made to see that the poeple in levels 
abcve NCEC get copies of the service 
Information and products NCEC is de- 
livering, e.g., keeping PREP kits 
visible, feeding In new packets of 
Information and new sets of exemplary 
programs. ERC's primary function Is 
to ^ct as a resource for OE and HEW 
staff in terms of reference work, 
searches, bibliographic materials, 
and other information services. A 
major effort of ERC is use of the 
DIALOG retrieval system to give rapid 
and complete access to the entire ERIC 
files in response to questions put In 
by pol icy makers . 



ERIC 
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w«s not certain Mh«ther this journat 
would be tailored so as to have partic- 
ular relevance for pot Icy rtakers. The 
new Journaf ftiay be directed to a nwre 
general audience Including practitioners. 



b) For professional practitioners : a 
"Manpower Research Visibility'^ col umn 
Is prepared for the American Vocational 
Journal under contract"! The American 
Bar Association (ABA) has been contracted 
by the Division to develop a newsletter 
aiined at a carefuUy selected mailing 
list of about 3>000 (mostly lawyers, 
state legislators, and others Involved 
in criminal justice); It will report 
ORO work dealing with employment barriers 
to offenders. ABA will also develop 
worlcshops of profi*as iona I groups who are 
able to talce action, and will repacicage 
elements of an earlier ORD product. 

Various Division staff members pre* 
pare materials ^ speeches, magazine 
articles, and displays for conventions, 
all of which could be viewed as tailoring 
for professionals. The Division has also 
encouraged project staff to appear at 
national conferences to report on their 
findings. The Manpower Magazine , developed 
by the MA information UTfice, can also 
be seen as a semi-'tat lored communication 
tool; ORO projects supply about 1/3 of 
the contents. 

Under contract with the Division, 
mul Ei-disclpl indry teams of graduate 
students at the University of Arizona 
are working under expert guidance to 
tr:>nslate, package, synthesize, and 
tailor research projects (including 
dissertations) for use by specific 
audi ences . 

Through the "buddy system" or 
through their own contacts, the Division 
continoaUy pushes for tailoring to 
specific audiences and usually these 
audiences are practitioners In Employ- 
ment Services. Rewriting, translating, 
and special formatting of various docu- 
ments are common tailoring procedures 
In the written medium. For example^ 
staff took the products of two evalua- 
tion studies and eight ESD reports on 
household workers and, with the Office 
of Education, the Women's Bureau In 
DOl, and the American Home Economics 
Association, prepared a package for 
broad distribution through all these 
agencies. Conferences which bring 
together R&O project directors and 
operating program people are also a 
convnon device and can be seen as 
^'taUoring" In the oral medium. 
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b) For professional practi t loners : The 
R$D Brief Ser ies / designed sped f I ca 1 1 y 
for this group, has a wide coverage 
which Is expanding over time. The 
Briefs are two-page summaries of 
selected projects and spell out Impli- 
cations for these users. SRS Research , 
the annotated listing, Is also sent 
to a large nuiriser of practitioners. 
In-house experimental efforts have re- 
cently been Initiated to develop a 
series of audio-visual Briefs of pro- 
jects discussed In the written Briefs . 

All the Regional Rehabilitation 
Research Institutes are funded to pro- 
vide consultation, to state Departments 
of Vocational Rehabilitation and to 
develop series of monographs on speci- 
fic treatment areas In rehabilitation. 
The University of Wisconsin Regional 
Rehabilitation Research Institute has 
been funded by RUB to experiment with 
a consultative project adapted from 
the "Visiting Psychologist" program 
of the American Psychological Associa- 
tion. Although there Is other material 
produced for practitioners on a decen- 
tralized basis, e.g., monographs, the 
scope of these activities »s not certain. 

The journals produced within SRS, 
i.e.. Aging , Rehabilitation Record , may 
also provide useful information, and 
the extent of coverage Is good. Staff 
members of RUB have themselves contri- 
buted articles to these journals on 
the utilization process and also .on 
selected subjects pertaining to rehabi- 
litation and social welfare research. 

The Division of Aging, in conjunc- 
tion with the Administration on Aging, 
distributes a series of Administrative 
Papers to practitioners In the field of 
aging. These Papers are produced bv 
the grantees soon after project comple- 
tion and contain either summaries or 
portions of the reports that have 
particular relevance to the audience 
at h«*id. They are not edited by ADA. 

\ 
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b) For professfonal practitioners ; The 
MHSV ts currently developing a magazine, 
innovat ions , whtch will be directed to 
pract 1 1 ioners both In mental health 
centers and In other mental heaUh fact- 
lit es . This magazine will include major 
articles, written under contract, on 
NIMH programs and other Innovative pro- 
grans; it also wlU address problems that 
people may have In the field, as well as 
provide solutions to these problems 
based on research, Innovative programs, 
and revtews of the literature. An 
occosfonal pamphlet has been developed 
by Branch staff for specific groups 
within the centers , e .9 . , a pamphlet 
on Indian mental health intended to 
reach both professionals and consumers. 

Although much of the effort of the 
Clearinghouse in the past has been 
devoted to researchers, they recently 
have developed a Journal, including con* 
densations of abstracts and articles, 
which has been of Interest to practi- 
tioners. The Center for Studies of 
Narcotic Addiction and Drug Abuse, in 
conj unct ion wi th the C lear tn9house for 
Dru9 Abuse Information, has produced 
various products such as films and 
educational materials for practitioners 
or "caretal<er*' groups. 

However, many efforts within NiMH 
are still directed to the research 
audience. For example, many of the 
symposia and conferences supported by 
the above-named Center and the Division 
of Extramural Research are designed 
specifically to disseminate Information 
to researchers. 



b) For professional practitioners : Tar- 
getted Commun I cat ions , an annua I program 
area of NCEC, are contracts which pro- 
duce summaries of what is currently 
kncMn about certain problem areas based 
on an examination of the literature, 
best practices, etc. One of the pro- 
ducts of each Targetted Communication 
contract Is a Putting Research into 
Educational Practice (PREP) report. 
This monthly report contains interpretive 
information about particular problems, 
e.g., examlna.tion of use of parapro- 
fesstonals In schools. In addition to 
the PREP reports, other dissemination 
efforts are. used In the Targetted 
Communication contracts. A second phase 
which emphasizes interpersonal communi- 
cation applies the same knowledge used 
in PREP at conferences and/or training 
sessions through film or audio presen- 
tations. A few of these "Phase it" 
contracts have been funded and NCEC 
hopes to be able to fund more of them. 

ERC uses many sources to perform 
their reference function: computer 
terminal operation, PREP kits plus a 
list of alt PREP kits. Clearinghouse 
products developed over the last year 
plus a list of al I past Clearinghouse 
products in one volume, copies of Model 
Programs developed by other Divisions, 
current copies of RIE and CUE , and 
certain directories. 



-11*9- 



Haaeimal D4U System 



f>!,A» Division of R&D Utilization 



SJS ReiearoH VtiliMati^ Branch 



h, 15 Interpretat ion 

The most Important and 
most difficult type of trans- 
formation is the Ifiterpreta* 
tion, i.e., transforming R&D 
into e plan of action for 
users. Even the most well- 
written report usually does 
not speak for itself, and 
receivers will often dismiss 
good research reports with 
a shrug and a "so what*' 
simply because no one has 
bothered to spej I out imp! i ^ 
cations, to indicate what 
act Ion., steps might be taken, 
.what policies changed, etc. 
This kind of actUlty takes 
much thought and skill, more- 
over It probably must also be 
targetted to particular users 
In particular circumstances. 
Probably most interpretation 
activity has to take place 
In a situation of face-to- 
face spoken exchange and 
dialogue between researchers 
and users. 

The maximal O&U system 
Invests heavily In Interpre- 
tation activities, both 
spoken and written, and It 
requires' a U of Its R&O 
grantees and contractors to 
involve themselves and con- 
cern themselves with utiliza- 
tion Issues. 



ERIC 



c) For general public : press releases 
were cUed as a form of Information 
tailored for the general public. How- 
ever, this group is not seen as a client 
within the scope of the Division's acti- 
vities, and so most tailoring Is directed 
to other groups . 



The Division has in the recent past 
extended Itself further and further Into 
the interpretation task to aid the user and 
In some sense do his Job for him. Some of 
these efforts appear to be done In-house but 
the more ambitious efforts are done under 
contract. One example of the former Is a 
very excellent brochure entitled "Orientation, 
Counselling, and Assessment in Manpower 
Programs,*' a 19 page pamphlet written In a 
lucid style which takes the reader by the 
hand and leads him through the basics. It 
also keys the reader to other resource 
material s. 

One example of the latter Is Gordon and 
Erfurt's recently published manual on Job 
coaching,* very carefully and thoughtfully 
written to fit the real situations tha^ the 
job counselor faces In trying to place Job 
seekers. The manual would appear to be the 
type of document that can fill a significant 
knoNledge gap. between research and practitioner. 
More documents of this type probably could be 
produced to fit the day-to-day needs of 
manpower professionals In various roles, 
assuming, of course, that there is sufficient 
research in given areas to make such inter- 
pretive works . reasonably valid. One problem 
Is the availability of good writers who both 
know the research and have a good feel for 
the practice situations. Through Or. Jesse 
Cordon's HanpOM^r Science Services, Inc. 1t> 



*This Is one of three coaching manuals 
developed by various contractors. 
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c) There has been some effort expended 
by RUB to reach the general public, 
although it has not been the focus of 
their activity. For this audience, 
RUB has sponsored projects to experl- 
inent with multi-media techniques of 
relaying Information, e.g., a documen- 
tary of the International research 
program. 



RUB is beginning efforts to Interpret 
and spell out action steps for users. The 
Briefs have been designed In-house to In- 
elude Impl Icatlons for users, although at 
a fal rly general level. There Is a basic 
distribution for all Briefs of 'i8,000; but 
beyond that , many of the Briefs have a 
special distribution. RUB is presently 
monitoring a project designed to develop 
a review of the ■ 1 1 terature on psychiatric 
rehabilitation, with a handbook to be 
developed from a summary of usable findings. 
Conferences on utMlzatton of research 
sponsored by RUB may also provide for 
Interpretive efforts. The guidelines devel- 
oped by RUB for final report writing and 
niore recently for appi 1 cat ions and continua- 
tion requests may also Induce the researcher 
himself to Identify and discuss implications 
of his work. 

Based on the directive from the Office 
of the Secretary, RUB and other staff will 
prepare Implications from RSD findings for 
the bureaus as a part of the accountability 
mandate. These written Implications are 
viewed as an Interpretive effort to assist 
the bureaus In implementing the findings. 
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c) Por general public ; Respons i b f I i t I es 
for reaching this audience lie primarily 
wi tn the Office of Communications. A 
Clearinghouse staff member has noted a 
treid within thfs Office to include the 
general public and practitioners as well 
as researchers In their dissemination 
efforts': this shift In widening the 
scope of coverage was attributed to the 
placement of the Public Inquiries Section 
In Che Clearinghouse in 1 969. Although 
such efforts of the Clearinghouse have 
been undertalten only recently, there Is 
already a contract underway which Is 
designed to produce twenty Fact Sheets for 
the general public. These Fact Sheets 
arc small pamphlets on critical areas of 
concern, e.g., juvenile delinquency, 
aging, alcohoHsm. Other efforts within 
this Office to reach the general public 
include television advertisements on 
specific mental health problems and gen- 
eral pamphlets. 



The MHSV has Initiated efforts which may 
have some vaJue for Interpretive activities, 
both written and oral. Some staff members 
have provided consultation to mental health 
service personnel which is sometimes used 
to pass on research Information to clients; 
more often It appears that these visits 
are based on a particular piece of research. 
Researchers themselves have been encouraged 
to serve as "action consultants" in spelling 
out implications of thetr research and in 
passing on Information. The Branfch and 
other MHS Program Division staff recently 
formed a Program Analysis Group to review 
results of evaluation contracts and to con- 
sider how various fmpUcatlons should be 
impleinented . ^ 

In conjunction with contractors. Branch 
staff recently have developed manuals on 
research utilization, on ways to use infor- 
mation sources, and on techniques of pro- 
gram evaluation. The proposed magazine to 
be developed by the Branch, Innovations , may 
provide a means to spell out Implications of 
research projects to clients, since some of 
lis articles will be designed to present 
problems and solutions to problems (sometimes 
based on research) of concern to the mental 
health service personnel .» However, since the 
fuU journal has not been produced yet, It Is 
not certain whether Its focus will be on 
Interpretive efforts. 



OE Nat torn I CanUr Sdujaticnal 
Corrmunioatiun 



^> ^or the ge neral public : Corwnunlcat Ion 
to the general public is not seen as 
a pan of the NCEC mission. 



Since the distinction between "tailoring" 
and "Interpretation" is not sharply defined, 
much of what has been said In the section 
above applies here also. "Targetted Cornnun- 
icatlons," for example, usually go beyond 
the mere presentation of facts to make deriva- 
tions of implications for their Intended 
audience. One of the products of the Tar- 
get ted Communi cation program, the PREP report, 
contains interpretive Information about 
particular problems. The PREP kits narrow 
dOMn the Information and are useful since 
"educators don't like to read alot." In 
the same way^, the extension agent system 
will take* the research to the teachers. 

There is an attempt to use a different 
range of communication resources at different 
stages of the adoption process. In one 
set of projects for example, after the 
priority areas have been Identified, there 
Is an assessment of the better programs lo- 
cated across the country that are concerned 
with the priority areas. The same project 
will provide a manuscript describing pro- 
grams; the Branch will subsequently produce 
a series of awareness pamphlets (e.g., on 
promising Career education programs) so 
that they can promote the selected programs. 

There Is concern In OE over the fact 
that teachers may have to choose among 
various products competing on the market. 
To alleviate this problem, the Far West 
L«boratory for Educational Research and 
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k.\€ Screening 

The max t mat D&U system 
employs a procedure for 
etimtnattng Irrelevant ^ re- 
dundant, and Invalidated 
knowledge from Its data base 
in an effort to screen for 
qual { ty materials. 
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Ann Arbor, Michigan, the Division Is exploring 
the feasibility of non-print media for train" 
Ing purposes (including self- Instruct lonal 
tape c|^settes and television taped instruc- 
tional systems for use by counselors), but 
so far the forays into the non-print audio- 
visual field have been scarce. 

Other in-hou\i efforts, have been under- 
taken to the end interpretation. To 
develop '*spin-of'^' from some R&D products 
Division staff nave met with OPE staff, with 
OPE taking the lead in formulating plans for 
action based on deficiencies in the system 
AS Indicated by R&D results, e.g., actions 
formulated from the Marshall studies on 
Negro employment. The contracted research 
reports are required to spell out policy 
impMcations, and this part of the reports Is 
carefully revlijwed in draft form by Division 
staff and other ORD staff. 

There does not appear to be any effort 
In the Division to make Interpretive trans- 
formations directly for the job seekers, 
themselves, or for the general public. 



Host of the Division's screening activi- 
ties are in terms of screening materials to 
send to particular audiences or user groups, 
in screening for utilization, the size of 
the potential audience, the quality of the 
report, and the amount of interest In the 
subject are taken into consideration. As 
the decision of how many copies of a report 
should be printed is made by Division staff, 
It Is very likely that this, may serve as 
a measurement of quality, I.e., those reports 
judged to be of high quality would be printed 
in large quantity. To deal with the problem 
of Irrelevant research, staff try to comb 
through their knowledge base to see If they 
can bend research to give answers to new 
quest ions . 

Selecting research to be included In the 
Advanced Research Briefs Involves screening 
at several different levels.^ Each agency that 
conducts research In OOL must select research 
Information that policy people should be aware 
of and then summarize the selected informa- 
tion and findings to spell out policy Impli- 
cations. In determining what research to 
send to the Secretary of DOL, staff must con- 
sider H the research findings have potential 
implications for policy pointing to new 
programs and If the research findings provide 
new insights to new programs. Project 
officers are responsible for reading and 
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Host of rub's screening activities con* 
cern the selection of projects to be sum- 
marized into R$D Briefs . At least one time, 
in 1969. all Research Briefs written by R&D 
project staff that had been received up to 
then were screened by RUB staff. The twenty 
considered best In terms of validity, 
potential contribution to programs (usable 
findings), and timeliness were given to 
members of RUAC for c^>mparat(ve evaluation. 
Their comments were then quantified and 
the results used as a guide In selecting \ 
reports to be briefed. Although final re- 
ports have not been systematically evaluated 
over the years es they came in, much In- 
formal evaluation has always occurred so 
that the better reports typically had a 
higher visibility both In the central 
office and In the field than the poorer 
reports . 

RUB is also concerned with verifica- 
tion and val idatlon .of existing research 
results. In the 19^2 RSD Strategy, RUB 
has proposed a project to perform an 
external evaluation of all completed pro- 
jects. One of the purposes of the Research 
Utilization laboratories funded by RUB is 
to replicate and validate existing projects. 



HI^ Merizai Health .<evi*i(s^^ Dev^tU^pmant Br^^ 



There was little evidence that Inter- 
pretation activities were common In other 
units of NIHH; this may be due, in part, 
to the unspecified number and type of cUents 
fn other units or to an emphasis on researchers 
as users, a group for whom Interpretation of 
research is not necessary. The Center for 
Studies of Crime and Delinquency, however, is 
considering the utilization of researchers as 
technical assistants to clients on a systema* 
tic basis through the funding of researchers 
for interpretation. 



Although there doesn't seem to be any 
overall hHSV activity designed to serve as 
a knowledge surveillance mechanism for staff 
members, Branch staff are expected to con- 
tinually review the emerging literature in 
their specialty areas. When a critical 
need for the development of better delivery 
techniques arises or when unsolicited grant 
proposals are received, the first responsf- 
blllt^ of the staff member is to ascertain 
whether knowledge already exists relevant 
to that need or proposal. Literature re- 
views of specific topic areas are often 
prepared for this purpose; however^ these 
reviews probably represent ^ forts tp liUe- 
grate the knowledge base rather than to 
screen for quality materials. Other screen- 
ing efforts Include a pa it of a new project 
designed to investigate better ways of 
screening for new knowledge, and an evaluation 
research measurement of the quality of in- 
coming reports fn terms of clarity, cogency, 
usefulness, and dissemination. 

In response to complaints of overlapping 
and unsystematized Information, an in-house 
study Is being conducted In the HHS Division 
to analyze what Information Is going to the 
Regional Offices and In what ways tt could 
be more precise. The National Clearing- 
house for Mental Health Information (NCHHI) 



OK NatiK'fkil Center fjv lCdu:\it:jn^l 
Carmuni cation 



Development has begun an ALERT system (Al- 
ternatives for Learning through Educational 
Research and Technology) which will look at 
all the packaged programs and products being 
offered and prepare documentation to help 
users make Intelligent choices, citing the 
advantages and disadvantages of each, but 
not saying which one Is best. As a fore- 
runner of this service, the Lat> had put out 
a series of multi-media kits (called 
"Integrated Information Units") describing 
curricula In social sciences and eleinentary 
science programs In a manner which allowed 
detailed comparison. 



As a result of early complaints about 
the quality of literature In the system, 
ERIC Clearinghouses have in recent years 
begun to do more selective screening of 
their Input. However, once documents are in 
the system, there is no further screening. 

NCEC has on one occasion engaged in 
a major screening of products of the USOE- 
supported Regional Laboratories and Centers. 
This evalution project, conducted by the 
Educational Testing Service, called for 
the Labs and Centers to submit a number of 
products they considered to be closest to 
the dissemination stage. An ETS panel of 
experts reviewed the products and selected 
nine that were most appropriate for addi-. 
tlonal dIsseminBt-ion efforts. Three pro- 
ducts received further dissemination efforts 
the Los Angeles (SWERL) Lab's reading 
materials, the San Francisco ("Far West") 
Lab*s Mini-Courses, and the University of 
Wisconsin R&O Center's Hultl-Unlt Elementary 
Schools. NCEC later subsidized special 
diffusion thrusts for two other products: 
the Far West Lab's Toy Lending Library and 
the Cooperative Urban Teacher Education 
(CUTE) project. Thus a total of five RSD 
based products received additional dissemin- 
ation efforts based on the ETS study. Last 
Hay. ETS was contracted to do a second 
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KnowledfljB Transmissions 

This function can be 
most simply analyzed accord- 
ing to the elements of the 
cofflmun feat ion formuta: who 
**YS what to whon by what 
channel to v/hat effect . The 
last element Is In the fonmj' 
la, the "effect,'* for the 
cas« of pure transmission 
without regard to the "help- 
ing'* function Is defined 
merely as recefpt of the 
message. The other elements 
can be analyzed as follows: 
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writing a report on "everything that comes 
In"*; they' must also send it somewhere, and 
the destination depends on the tlmeUness and^ 
impact of the product. 

In 1968 the Labor Market Information (LNI) 
Program was established under Section 106 of 
the Manpower Development and Training Act. It 
is stipulated, that 2% of theJI.A. budget tnust 
be used to improve quality and quantity of 
information on the labor market available to 
users of this Information (Including state^ 
and local employment offices, Job seekers^ 
etc.). • . 

Although the Division of R&D Utilization 
and the larger units within which it works 
appear to have many viable procedures for 
screening for new knowledge and for target ting 
new products for particular user groups j it 
Is not certain whether these screen! n''^ 
mechanisms continue to operate on th-s exist Ing 
knowledge base In an effort to eliminate » 
materials of lesser quality. 



One non-RUB respondent stated that 
the general policy of SRS is to scruilnfze 
the whole research program to see whether 
the research Is usef ul » and If it is not, 
In. numerous cases the projects will be 
discontinued. 
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Is concerned with the scientific and pro- 
fessional accuracy of the body of informotlon 
with which It works. In-house quality control 
Involves staff members keeping up on all 
developnvents In the field and sampling all 
Input and all output. Given that the Clear-^ 
inghouse contains such a plethora of informa- 
tion, one respondent fait that this overload 
m^9h^ cut down on utilization "just from 
users screening out too much themsclvus ." 

It appears that the Branch and the larger 
agency have procedures for screening for 
new knowledge, but It was uncertain as to 
whether they screened the knowledge already 
present in the data base In terms of elimina- 
ting some of lesser quality materials. 



evaluation study. It was fett ^that once a 
file of promising practices was collected* 
it would be necessary to have an Independent 
validation of these school-based practices. 
This type of evaluation was done on the 
reading scries. 

Some of the practices to be exhibited 
at the Education Innovation Fair (BES£) 
were ^al [dated by NCEC through criteria used 
to Identify 20 successful Title I projects. 
The criteria developed jointly by the Bureau, 
NCEC and a contracted researcher Include the 
requirements that the project must be within 
a reasonable price range so It can be re- 
plicated and that the project has to be in 
operation for at least two years, with demon- 
strated success and continuity. Subse* 
quently, these criteria were dropped and 
replaced by the more rudimentary requirements 
that the projects* are in legal compliance 
and havfl demonstrated good results. B£SE 
Is having problems locating and disseminating 
a great number of projects or practices that 
they can stand behind in terms of validated 
efforts. For this reason, the Idea of 
incorporating state selection for validation 
is a consideration, t-f the states think 
that projects are good, they can submit an 
application to have projects disseminated. 
By preparing states to do their OMn evalua- 
tions as Innovation projects, It is hoped 
that states will be able to create innova- 
tions and not just the structures around 
the Innovations. Furthermore, It was felt 
that NCEC could not do the validation work 
for the Bureau as they would never hav^ 
enough money. 



Along with an ongoing commitment to a 
certain critical mass of transformation and 
acquisition functions, within NCEC there 
Is a' trend toward more and more transmission 
activities. 
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h.2\ WHO: Research and 

devflt'opment producers 
who work in areas 
, relevant to the 
agency's mission. 

maxima) D&U system: 

a) has defined what these' 
' sources should be 



t>) h»s an awareness of who 
and where they are 



a) The relevant research community is 
not clearly defined (n any formal sense. 
The Division' t'ends to limit its defini-* 
tion of research to that sponsored by 
ORD, primarily due to lack of staff time 
and resources. However, many RSD reports, 
contain good' reviews of the literature, 
and these are^som^t imes used by the staff. 
The Staff, with d^ep involvement in s'ome ' 
projects and area^, are able to pick up 
and relay reports, articles* etc., on 
work not sponsored directly by ORD'. 



b) The Division seems to have good In- 
formal awareness of key established 
researofVfrs In the manpower area, as 
represented by work in the Manpower R&D 
Projects annual report and membership on 
the National Manpower Policy Task Force, 
a group formed of prominent researchers 
in the field. The Research Subcommittee 
of the 'National Manpower Advisory Council 
is another source of guidance. Jn 
, addition, the dissertation grants program 
and the annual New Manpower Researchers 
Conference bring new researchers to the 
surface and give^t^C" ^P*^ familiarity 
with the agency, while making Division 
and other staff aware of them. 
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a) There is no^clear definition of 
the relevant universe of researchers, 
particularly sirce'such a wide range 
of research programs exists.Jn SRS. 
RUB initially limited its (Jefinitijon 
of research to that sponsoi^ed by. the 
rehabtl I tat ion research prBgram, al-. 
thpugh the Branch hsfts been expand l*ng 
Its universe to include social wel' 
fare researchers, etc, to obtain 
an SRS-wide scope. 

' . Earlier, there was more reliance 
on unsolicited proposals in making 
funding declsiprs, which may have 
limited the definition of researchers 
to those well established. However, 
SRS has been turning increasingly to 
RFP's In soliciting researchers. 



b) The Branch has a general aware- 
ness of the rehabilitation research 
community, especially since much of 
this research Is done by the client 
groups themselves ($0% or more of 
these projects are done outside of 
a univers I ty . sett I ng by state 
Departments of Vocational Rehabili- 
tation, by nonprofit and profit 
national organizations, etc). There 
has also been a conscious development 
of a "cadre" of people who can now do 
research fn fl'^lds that didn*t even 
exist before. This development comes 
through support for establishment of 
new professional schools in universi- 
ties and through the bureau training 
progr'sms. 

Previously, external review 
boards composed of researchers were 
used to shape and direct the R£D 
efforts. However, the function of 
the review boards has changed to 
that of reacting to proposed SRS re- 
search. Staff members noted that 
they still know where these experts 
^'re and can seek their advice when 
needed. 



IS- 



ERIC 



NIMff Mental Health ^r-ivij-t'd Uypmi^nf HiMnoh 



, a) Given the i nter-di sci pi ) nary nature 
of mental health research, there lis not 
just one relevant population of re- 
searchers, but many. No one unit in 
NIMH has responsibility for defining 
all of the R&D resources of the agency ; 
instead, this defining process pccurs 
on a more decentralized basis. Staff 
in each program and research area 
wlfiln and outside of the HHSV have in- 
formally defined the relevant researchers 
in their areas of expertise, e.g., staff 
in the^HHSV would define R&D sources in 
the sub-areas of mental health services. 
Although there may be some overlap 
among these populations of researchers 
in the various NIHH program$, it was 
not clear whether there was' any system 
for determining where the o^verlap exists. 

*b) The HHSV staff members, as well as 
staff in other parts of thje agency, 
have a fairly high level of awareness 
of in-house and outside rejsearchers In 
their particular areas of linterest. A 
good example of this awarepess is the 

^ "cadre" which was organized by a staff 
member of the MHSV. This Vcadre" Is 
'composed of experts in thelarea of 
children's services and was\ developed 
through the staff member's cognizance 
of the available experts within NIMH. 
This awareness can be partia\ny attri- 
buted to the attempt noted by^ most staff 
members Interviewed to "keep ^n top" 
of their areas of expertise; siytaff are 
entouraged to maintain contacts with 
researchers In their field. It\was 
reported that an awareness of research- 
ers was promoted by consul tation\ around 
project applications, by conferences, 
and by attendance and participation in 
professional meetings. One other \mechan- 
ism to develop staff awareness of the 
fields of researchers is the training 
programs .ohich exist In NIMH, some of 
which are designed to develop new re- 
searcher potentials; however, it Is \ 
not certain how well the training and 
research components of the separate \ 
units of NIMH are linked together. \ 

\ 
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a) NCEC's potential researcher pool 
Includes the entire educational ReD 
community, a very large, widely 
dispersed and still rapidly expanding 
sub-culture, visibly but not Inclu- 
sively represented by the American 
Educational Research Association (AERA) 



b) The NCEC leadership participates 
fairly vigorously and visibly In AERA 
meetings and maintains professional 
contact with specialty fields through 
the decentralized Clearinghouses, some 
of which are attached to their specialty 
professional associations. Through the 
comprehensive literature indexing of 
ERIC, NCEC also has a potential capa- 
bility of identifying tens of thousands 
of researchers by specialty, Interest, 
geography, etc. 



c) has access to ihcm and 
the i r wo r k 



k .22 TO WHOM : The users of 
research and develop- 
ment . 

The maxima) O&U system: 

a) has def ined who the user- 
receivers of the R&0 
should be 



M.A. C^ii^isxon c>f K5.'* Utilisation 



c) The annual review mentioned above 
appears to give good access to the »vork 
of researchers. Access to the researchers 
themselves appears to be more nmited; 
staff members mentioned that there is 
a small "stable*' of researchers with 
whom they have worked, and with whom 
they are thus more likely to contact 
^n the future. Sponsorship by ORD of 
the Experimental Manpower Laboratories 
is another means of maintaining access 
to this group of researchers. One 
respondentMndi cated the possible 
difficulty in getting researchers in- 
terested in working on problems staff 
members see as needing research. Sole 
source funding of researchers (nrore 
corwon tn the past, and now changing) 
also may have limited the number of 
researchers with whom staff members 
might be fami liar. 



a) There is considerable discussion of 
this, and a division of opinion. Re- 
search is viewed as primarily relevant 
for policy makers, while ESD projects 
are seen as primarily directed to USES, 
OEDP, and state agencies. There Is very 
little consideration of reaching con- 
sumers directly, and no concern for * 
reaching the general public through 
the mass media. Also, researchers as 
an audience get little attention. 



SRS Fi,8, i".*' 



c) RUB may have access to at least 
^ome researchers, since the Regional 
Research Institutes, Research Utiliza- 
tion Labs, and the RfiT Centers are 
funded by and responsible to the 
agency. The annotated listing and 
other well documented publications 
may also give access to the work of 
researchers , 



a) There has been concern in SR5 
to define the relevant users since 
the agency offers such a diversity of 
services, yet there are still differ- 
ences of opinion. Researchers are 
encouraged to define more clearly the 
users of each product so they are no 
longer identified in such broad terms 
as to Include ''almost the universe." 

Although the bureaus have their 
own "target populations" and Congres- 
sional committees to which they report, 
there has been some effort to Identify 
overlapping client groups where such 
overlap does exist. On the other hand, 
the Issue has been raised of whether 
the research program has used the 
legislative mandates too loosely. 
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c) oiven the major emphasis of the 
WHSV and other portions of NIMH on 
research development, there Is great 
opportunity for access to researchers 
by means of consul tat Ion wi th potential 
applicants.. Outsiders and staff within 
MHSV also cited the use of conferences, 
professional organizations, and informal 
cncetlngs as ways of maintaining con- 
tacts with their specific "stables" 
of researchers* 

Access through project monitoring 
apparently has not been as s-trongly 
emphasized as pre-funding consultation, 
given the heavy Investment of staff 
time throughout NIMH fn the "develop- 
ment" of research projects. 



a) As one respondent stated « "each ^ 
Division has Its own users and Its own 
ways of thinking about applications of 
knowledge." Thus, the definition of 
relevant users appears to be based on 
the type of research funded by each 
specific unit, with clfents ranging 
-from those people who are likely Co have 
some Impact on changing the delivery of 
mental health services In the MHSV pro- 
gram to "just the scientists themselves" 
in the more basic research programs of 
NiMH. It also was evident that some 
of the units did not define their client 
groups very sped f i ca I ly » although some 
units have begun making conscious efforts 
to specify clients. OPPE has clearly 
defined & select group of policy makers 
as recipients for the evaluation studies 
they sponsor. Although initially 
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c) Access to this sprawling network Is 
necessarily limited and selective. 
Because NCEC has had only a very limited 
and restricted research budget, its 
primary means of accessing researchers 
directly is via small contracts to 
.develop bibliographies, review litera- 
ture, and make Interpretive summaries. 
Much of this work Is channeled through 
the Clearinghouses. The Clearinghouses, 
(n turn, are likely to be somewhat 
parochial both In terms of their 
specialties and their geography. There 
Is also some doubt as to whether the 
ERIC centers can attract the highest 
calibre of researchers for these tasks, 
especially with very limited and restricted 
budgets at their disposal. 

in contrast, within the specialty 
of 0£U research, NCEC has excellent 
contacts with key scholars through its 
Research Advisory Committee and through 
a series of contracts with research 
centers at Michigan, Michigan State, 
Columbia, and Stanford. When promising 
researchers emerge in this field, the 
NCEC leadership is almost Immediately 
aware of who they are and Is generally 
receptive to their Input. 



a) Broadly speaking, NCEC's clients 
Include the professional educational 
community in general with special 
emphasis on practitioners and decision 
makers in operating school districts 
across the nation. Out of this total 
population, certain subsystems have 
been singled out as special priority 
targets because of their special status 
as key decision makers or linkers to 
the rest of the system. Thus, the 
state education agencies have received 
special attention and state personnel 
receive the most contact on a day- to- ^.^ 
day basis. 

Educational decision makers who 
need access to valid Information t.o 
make rational decisions are also con- 
sidered to be priority clients; these 
include curriculum development people, 
superintendents, principa^s» and local 
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b) has an awareness of who 
they are and where they 
are located 
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b) There Is good knowledge of policy 
people fn direct chain of convnand, and 
knowledge of channels or offices by 
which they transmit Information. 



Also there Is reasonably good aware- 
ess of state agencies as an audience; 
t we are not sure If this awareness 
extends deeply Into all those agencies 
offering employment help. There was 
some concern expressed over the limited 
Information avall'^ble about this audience, 
e.g. , organizational studies. 

We found little awareness of re- 
searchers, Job seekers or the general 
public as audiences. 
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b) There Is good knowledge of the 
chain of policy people dnd the formal 
channels through which information can 
be transmitted to them. The Chief 
of RUB has been assigned by the Office 
of Planning, Research, and Training 
(OPRT) as the "Objective Wanager" to 
work on the objective of developing 
a communication plan for OPRT; he 
has developed a flow chart which in- 
dicates the links and clearance pro- 
cedures for all Information passed 
through the agency. 

There Is some awareness of state 
agent tes as an audience, particularly 
since the Research Utilization 
Specialists have been assigned to 
link f;o this audience directly. The 
exter/ of knowledge available about this 
audience is not certain. 
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operating primarily for researchers and 
the scientific cofnmunity, the Clearing- 
house staff noted that they are conscious^ 
ly Including other groups in their client 
base, ranging from students to practi- 
tioners and the genera} public. 



b) Given that various units in NIHH 
define their clients at different levels 
of specificity, there is a varying aware- 
ness of who they are. The MHSV, given 
the nature of their services to a well- 
defined population of clients (including 
mental health centers and hospitals), 
can locate their cl iffnts rel at ively 
easily. Staff in portions of the basic 
research programs have a good aware* 
ness of the researchers (in this case, 
clients) included In their peer group. 
Hc^^ever, there was not a general aware- 
ness throughout NiHI-l regarding the client 
groups of other units. For example, 
one staff member in the basic research 
program noted that in trying to develop 
a project which would encourage basic 
researchers and practitioners to work to- 
gether, he would not be able to identi** 
fy the practitioners who would be in- 
terested in such a venture. 



OS National Certter /v^r EducatiL^nat 
Conmunicat { ort 



and regional curriculutti and instructional 
leaders and coordinators. The Dissemina- 
tion Programs Branch is more concerned 
with local agencfes; most of the Branch 
efforts are directed to people in 
curriculum development at the local 
level rather than at the state level. 
Clients of the Educational Reference 
Center (ERC) are educational decision 
makers with In OE. 

In the three pilot state programs 
of NCEC, each state had to decide how 
they would employ their extension 
agent: two states used Intermediate 
district offices and the third, local 
districts. The agent Is situated at 
the district or local level In order 
to be able to have access to local 
teachers and administrators. 

The educational field was seen by 
one NCEC respondent as being like a 
"patchwork": various programs, legisla- 
tive authorizations, and constituencies. 
This creates a problem of duplication 
which Is not a result of physical 
distance. "It's just not easy to 
distinguish differences In programs 
sometimes, e.g<, when you tell a bureau 
that NCEC Is about to d'issemlnate some- 
thing for them, they will Just say 
that it Is not enough." This respon- 
dent felt that many people In OE don't 
know what NCEC Is "all about." Al- 
though one way to avoid such duplication 
of efforts would be through Joint fund- 
ing, there are legal difficulties pre- 
sent. By law, some 'funds can on}y (;be 
used for certain types of agencies, 
certain types of client systems, or 
only by contract or grant. 

b) The c?fents of the extension system 
include educators (both teachers and 
administrators) at the state and local 
levels. The agents themselves will be 
serving the local level primarily be- 
cause they will be placed in local 
unl ts . 

two current contracts are partly 
aimed at building greater awareness of 
potential knowledge users. One con- 
tract with Havelock at Michigan is 
surveying resource utilization in the 
innovation process in a national proba- 
bility sample of 350 school districts. 
The project wiU shcjw the extent of use 
of such facilities as ERIC at the 
local level in different regions and 
in districts of different size and 
character. Another project by Paisley 
a Stanford will identify users and 
user Information needs by educational 
role. 



-161- 



c) has access to them 



c) Utilization staff have good access 
to policy people in direct chain of 
command through streams of memos, re- 
quested position statements, and infor- 
mal contacts, but steps are not jumped 
easily. The ORO director is able and 
willing to take the initiative to 
reach top levels if he feels it Is 
warranted. The National Hanpower Policy* 
Tasl< Force and the Nation.dl Manpower 
Advisory Committee, through its Research 
Subcommittee, are important potential 
sources of influence at the highest 
level as Is the Manpower Report of the 
President . 

Contacts with the Office of Policy 
and Evaluation (OPE) have not been 
formalized, with the Oivlsion having 
no regular access to this Office; OPE 
has responsibilities for sending research 
Information to the policy makers. OPE, 
in turn, may not be receiving all policy 
relevant research that could be passed 
upwards. A new staff member of the 
Di vis Ion of R&D Ut 1 1 Izat ion, who former- 
ly worked In OPE, recently has been 
assigned to develop contacts with cer- 
tain staff in OPE In order to improve 
access. Part of the problem has*«been 
that staff feel that they must know 
policy needs better; OPE has not yet 
given any guidelines regarding these 
needs . 

Access of the Division to the re- 
gional, state* and local offices is 
also Incomplete. The Division and other 
units at the federal level must clear 
through the Deputy Manpower Administra- 
tor's Office all material which Is sent 
to the regions. The regional and state 
offices, in turn, have the option of 
distributing materials as they choose. 
To improve access to the regions, two 
iDIvisIon staff members have been 
assigned to develop plans for Informal 
comnunlcat ion wl th the regionaj offices. 
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little mention wa> made of re- 
searcher^ or the general public as 
audiences, although somcf efforts have 
been expended on behalf of both. 



c] Accesb to policy makers is primarily 
through formal channels. Involving 
required clearance procedures. 

Access to others in ORD and to 
the program people has been potentially 
increased by the establishment of 
liaison persons in all the research 
divisions and bureaus. Task .forces 
and committee meetings which are 
common ly organized to work on specific 
problems also serve as good entry 
po i n t s . 

Most of the regions have recently 
designated **R&D Specialists" who may 
serve as a ^'bridge,'* although all in- 
formation sent from the central organ- 
Izati(^ must be cleared through the 
Office of the Associate Administrator 
for Field Operations. The role of 
the RU Spec i.i lists has been designed 
to break Into the state and regional 
network (or create a network if none 
exists) although the effectiveness 
of this role is not yet known. RUB 
has expressed great concern to develop 
a ''linkage model" at the local and 
state levels. 



c) The primary mode of access to policy 
makers open to Division staffs appeals 
to be through In-house task forces and 
committees which are occasionally set 
up dround specific problem areas. For- 
mal, written reports sent to these 
policy makers were cited as another point 
of access. However, staff In the Offices 
appear to have more ready access to this 
use' group given that some of them have 
been assigned the respons ih ! i t ty of 
providing ready respo.;.es to the re- 
quests of this group. 

NiMH has been described by some 
respondents as a very "horizontal" and 
"isolated" structure; although staff 
members in the various units have 
phyi icat access to each other in that 
they are located in the same building, 
it was not clear whether this physical 
proximity carried over into actual 
Interactions in all cases. 

Access to the practitioner groups 
is rot common to all of the units in 
NIMK. The MHSV and its larger Dij/lslon 
have a good source of access to local 
mental health centers through their 
mechanism of providing grants for the 
operation of the local centers; one 
staff member noted that these grants . 
helped to "open doors and stimulate 
communication." Access to the Regional 
Offices by the MHSV and the MHS Program 
Division also appears to be good, given 
the historical ties with the regional 
staff. At one time, regional staff 
were funded by this central office and 
this tie has carried over to the 
present, even though the staffs are no 
loHjger commonly funded. Access to these 
Regional Offices by other units is not 
so weH developed; one respondent noted 
that the only access or outlet he 
presently had to the regions was through 
the guidelines they developed at the 
federal level. 
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c) NCEC goes through f ntermedlaries to 
reach users: in the National Secretariat 
Project, they have established a formal 
structure to, "get into" the 50 states. 
There is one dissemination representa- 
tive (nominated by the Chief State 
Officer) in each state and these repre- 
sentatives meet once or twice a year. 
An Important purpose of these meetings 
is to allow cross-fertilization and 
learning between NCEC staff and the repre- 
sentatives. Information is presented on 
the dissemination programs operating 
under NCEC, needs and reactions to 
NCEC products and polfcles are solicited, 
and the dissemination representatives 
Inform NCEC of their activities. There 
is contact with some policy makers in 
OPPE on a weekly basis. 

The Clearinghouse staffs have close 
associations with their professional 
groups and many of the Clearinghouses 
have columns in professional journals 
to reach specialized audiences within 
their professional fields. NCEC staff 
members have participated on a number 
of task forces around different areas, 
e . g . ^ renewa I s t rategy . The re i s con- 
tact with 6ESE and Titles t and 111 
staff members who know the states well 
and who disseminate for these programs. 
However, not ail NCEC staff members are 
f ami I la r wi th the Title III disseminati on 
efforts. As there Is some overlap in 
the functions of the units within OE, 
NCEC staff members have devoted time 
to liaison activities in an effort to 
prevent duplication of efforts. 



ERIC 
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d) has surveillance mechan- 
isms capable of identify- 
ing new and potential 
users 



^.23 WHAT : The Research and 
Development Knowledge 
Base relevant to the 
agency's mission. 

The maximal OC*J system: 

a) has the capacity to have 
published or reproduced 
any document from the 
knowledge base )n suffi- 
cient quantity to reach 
ail appropriate and ready 
users at a given point in 
time 
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d) The Division, through some of its 
contracts, has been attempting to 
Identify potential users. For example, 
in the project with the University of 
Arizona, special packages will be 
developed for new audiences, e.g., school 
counselors and employees. Yet this )s 
still done on a project by project basts, 
with no general scanning mechanisms 
established. Although congressional 
mandate does not provide specifically 
for this kind of activity, the mandate 
Is broad enough for the Division to 
work in this area. Also, new research 
topics appear to generate self-evident 
user groups (e.g., the shift from auto- 
mation to training the disadvantaged 
brought In new clients). 



a) There is heavy dependency on the U.S. 
Government Printing Office (GPO) ; use of 
GPO Is required by law| which results 
In delays and adds steps to decision 
making. Very rapid turnaround of "hot" 
Items seems to be impossible as Is 
the reprinting or distribution of docu- 
ments not printed by GPO (e.g., reprints 
from journals). Also, the money allo- 
cated for publications Is rather severely 
limited and mos t of it is allocated to 
the Manpower Report . 



d) New objectives and ^r i or i l i es 
developed by the top administrators 
generate new target populations, e.g., 
the shift to Integrate services and 
the priority of the welfare client. 
However, there Is no mechanism for 
surveillance of other potential 
audiences; Instead, the legislative 
mandates have worked against develop- 
ing mechanisms for expansion of client 
groups . 



a) It Is a requirement that all docu- 
ments produced In-house for publica- 
tion, e.g., SRS Research , must be 
published by the U.S. Covernmeni 
Printing Office (C.P.O), which neces- 
sitates much editorial work.- The 
majority of reports are either mimeo" 
graphed, muTtilithed, or are published 
as monographs for wider distribution. 
The project director is responsible 
for the prlntlng--supplemental awards 
for printing are usually made only 
when the report Is to be published as 
a monograph or In some other form. 
RUB does not possess the capacity 
for rapid, in-house reproduction for 
wide distribution. 
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d) There is no visible mechanism avail* 
abie across the units in NIKH for the 
surveillance of potential user groups. 
One HHSV staff member noted tt^at their 
viftv of their client base has been some- 
what "parochiaT' and that this view may 
carry over to other portions of the 
Institute as weM : applied R&O is viewed 
as relevant to mental health serv.ice 
perrionnel and more baste research pro*- 
grams are viewed as relevant to research- 
ers. However, there is one mechanism 
recently developed on ^ smaU scale 
which could be expanded to survey the 
usefulness of various research programs 
for various client groups. The Program 
Analysis Group set up in the Hl^S Program 
Division to review evaluation contracts 
for their Implications and use for 
different groups could be expanded to 
include more user groups as well as 
more types of research products In NIHH. 
Others outside of the Branch noted some 
concern over expanding the relevant 
client population: "we have worked a 
great deal with professional audiences, 
but now lt*s time to worry about the 
government organization downward and 
the people upward in the organization, 
i.e., pol Icy maimers 



a) The requirement that all documents 
produced In-house for publication must 
be printed by the U.S. Government Print-' 
ing Office (GPO) requires editorial work 
and sometimes a long time period to 
get things out; some people estimated 
from 3"9 months. It appears that the 
various units in NlliH do not possess 
the capacity for rapid, in-house repro- 
duction of items for widespread distribu- 
tion (capacity in terms of money and 
in terms of equipment). Staff members 
in several units of NIMH cited this 
(deficiency as a problem, since as 
few as 10 copies of reports are avail- 
able from research projects for distri- 
bution. However, one respondent In OPPE 
cited the use of a reproduction faci- 
lity in Lexington, Kentucky, which has 
the capacity for rapid reproduction and 
ever distribution of ihetr evaluation 
reports; whether this same facility 
IS available toother units in NIMH 
is not certain. Some units, e.g., the 
basic research programs, assume that 
the primary place for research results 
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d) There fs no current mechanism for 
regular surveillance of needs and identi- 
fication of users. However, both the 
Havelock and the Paisley projects r,en- 
tioned in ^,22b above are designed as 
pilot projects to explore the possibility 
of periodic systematic monitoring of 
this kind. 

In BESE, staff members are planning 
to set up Task Forces to help them 
identify new and potential buyers of 
Innovations displayed at their Education 
Innovation Fair; they are not only 
trying to Identify individual adopters 
or buyers, but also "adopter systems." 



a) NCEC has been viewed as (he program 
with respons i^bi 1 1 ty for dissemination. 
Bureau staffs are asked to put together 
a list of programs and projects which 
they think are exemplary in nature and 
NCEC selects programs and projects 
to "push" from these lists. NCEC then 
tries to disseminate Information about 
these programs and to assist in imple- 
menting them; however, dollar con- 
straints limit the number of selected 
products. Although NCEC works for 
collaborative establishment of criteria 
In the'val idation process with the 
Bureaus, Bureau sLaff are not always 
pleased with the products selected from 
their Bureaus. 

Although NCEC uses available re- 
production facilities as much as possi- 
ble, all printing runs of over 25*000 
pages must go through the Government 
Printing Office (GPO). This process 
represents a bottleneck in that the 
average GPO turnaround Is from four to 
six months. The In-house clearance 
procedures are also becoming more com- 
plicated in that thcsre Is an OE Publica- 



-165- 



Maximal DSU Syatan 



M»A» Division of R&D Utilization 



SRS Hoeeapch Utilization Branch 



b) labels and otherwise t>) '^^^ reports submitted by con- 

appropriately identifies tractors are widely distributed and are 

documents and knowledge- never anonymous. However, most other 

able persons documents involving transformations 

appear to be anonymous. In fact » .authors ' 
and editors* names are sometimes deliber- 
ately deleted or burled (e.g.. Break- 
through for Disadvantaged YouthJ ^ Th i s 
may be a result of an official written 
policy promulgated by Che Department 
Office of Information, Publications, 



b) Documents are generally well iden- 
tified as to origin and sources for 
further Information, e.g., each of 
the R&D Briefs lists the title of 
the fuU report and the address of 
the grantee. 
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to appear will be in Ihe varfous 
professional journa!3, which could re- 
quire a tag time of froni 1-3 years 
after the termination of the project. 



b) Documents produced by the various 
units such as the Clearinghouse, OPPE, 
and specific Divisions^ generally 
identify both the source of the ir^for- 
mat I on (as to who developed tt) and 
the places to obtain more Informatilon. 
Host of the items produced In-house go 
through the Clearinghouse staff, stnce 
"they are the hardware peopie and the 
operating arirf* of MIHH. 



OE national CenUv EduautionaL 
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tlons Office that must review every- 
thing as well as five or six other 
steps in the review process. Some 
ERIC Clearinghouses have developed ' 
outside arrangements to get their pro- 
ducts printed free of charge; those 
Clearinghouses that publish their own 
materials have to go through GPO which 
adds several steps and takes more, time. 

The Dissemination Programs Branch 
receives 500 copies of the PREP re- 
port each month and sends half of these 
to the state dissemination representa- 
tives. Advance notice of each report 
is given fn a PREP Brief which is mailed 
out with the preceding month's PREP 
report. Two hundred copies of this 
brief are mailed to each state agency 
as well for distribution and advance 
order purposes. The states can then 
order In bulk from GPO or, like some 
states are doing presently, xerox 
copies by the hundreds and thousands 
to distribute within their states. It 
Is cheaper to order from GPO, but it 
takes longer. 

A request for copyright In'thc 
early stages of project development Is 
encouraged by the Copyright Program 
staff in order to save time; otherwise, 
If the developer waits until the project 
is com^Sleted, it could be from one to 
two years before the finished product 
Is processed and ready for market. In 
some cases, the publishers help In 
this early stage of development and 
put ''in some of their own money for the 
project to speed up completion. 

One non-NCCC respondent noted a 
complaint that state people often have 
about ERIC: those people who do know 
about ERIC complain that it's a great 
bother to get the Information as It 
may take months to get a request filled 
and once fhey receive the Inforoiat ion, 
It may not be what they want. Some 
NCEC personnel would agree that there 
are serious turnaround problems wi th 
some ERIC products as a result of 
the GPO and EDRS process. 



b) For each document selected for ERIC, 
the Clearinghouses prepare a biblio- 
graphic citation, a 200 word abstract, 
and a list of descriptors keyed to the 
ERIC Thesaurus. Citations and ab* 
stracts are compiled, and published In 
Research In Education (RIE), 
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c) catalogues and sorts all 
documents in the knowledge 
base for retrievabM } ty 
by all audiences accord- 
ing to their interest and 
is able to do th!s (or 
have It done] on a con- 
tinuous basis as new 
knowledge is generated 



M.A. Diviaion oj' BSD Utilisation 



and Reports. Apart from the obvious 
disservice to such persons^ such practices 
make It more difficult to identil^y docu* 
ments and to reflate them to previous 
work done by the same ptfople» They also 
make it difficult for users to find 
responsible experts on a given topic 
through thei r works . 

c) The annual Manpower R$D Projects Is 
. a means of doing this. An i ndex to 
subjects and authors is provided. There 
is also a cumulative index for research, 
though not for E^D projects. The 
"Projects" report does not Include studies 
other than those funded by ORD even In- 
side the Labor Department. 

One of the secretaries aiso main- 
tains an extensive record of names and 
addresses of those interested In con- 
tinually receiving Information In 
general » as well as lists of those In- 
terested In specific subject areas. 



\ 
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c) The voluma SRS Research produced 
by RUB contains a cumulative annotated 
listing of aU research projects and 
films funded by the SRS research program 
since Its beginning In 1555- There 
Is a subject matter index and aoprc* 
ject number index, although no author 
Index. This .volume wi l I be updated 
annually. It does not include In- 
house material or related materials 
produced outside of SRS. However, RUB 
has developed a guide on how to use 
other existing information systems, 
such as ERIC. 

Other cataloguing and sorting 
occurs on a decentralized basis. The 
Division of Research and Training 
Centers has set up an information and 
clearinghouse function among the Re~ 
search and Training (R&T) Centers, \jslng 
such devices as a newsletter ( The 

1 n former) and a Directory of research, 

projects (and abstracts) developed in 
the Centers. Future plans include a 
compilation of audio-visua) material 
developed by the Centers and a biblio- 
graphy of Center publications and re* 
prints. 

Stout State Colleg^ in Wisconsin 
has been funded to develop a clearing- 
house in a specific subject area. 
The Florida RRRi has developed its 
own bibliography, and extended annota- 
tions of l.,i*0O reports have been spon- 
sored In several areas. 

The institute for the Crippled 
and Disabled OCD), one of the RU 
Labs, has also been given funds to 
develop a clearinghouse on the rehabi- 
litation of public welfare recipients; " 
their survey of available research 
and literature has gone far beyond 
that funded by SRS. 
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ComruniQation 



There is no corresponditig file of 
<i ' knowledgeable persons who could act 

as eiKpert consultants on specific educa* 
tlonal problems, apart from authors of 
ERi C docMrnerrts . 



c) The National Clear inghouse -for Hcntal 
Health-Information (NCHHl) was establish- 
ed tn T963 and has become 'the center 
in NIHH for the "conectfon, storage, 
retrieval, and dissemination of scienti- 
fic information*' in the area of mental 
heaUh, Included in its computerized 
Information system are abstracts from 
926 "high yield" journals from all over 
the world, with 2600 journals of "lower 
yield" also reviewed for relevant *art i- 
cles. Books, monographs, workshop and 
conference proceedings, etc., also are 
Included In this information base, o 
although it was not certain how exten-- 
sive the coverage Is of such material. 
Such materials as documentation of 
exemplary practices or programs pre- 
sently are not' Includeo In this base, 
although they are being considered for 
coverage. The 200-300 word abstracts 
are the prime source of Indexing terms 
for each document; thefr Document Pro- 
cessing autolnatlc indexing system offers 
each word In the abstract as a candi- 
date for Inclusion In the mental health 
vocabulary. Thus /a thesaurus of terms 
Xs not necessary to search the docu- 
ment base. 

There are other flies maintained by 
the Clearinghouse beyond the general 
NCMHI flic. The Law file IS composed 
.of all of the state laws which pertain 
to mental heaUh. The Research Grants 
file, containing about 20D0 on-going 
records, contains information on grants 
which are presently active In NIMH; 
such information on each, grant would 
Include the purpose, subject, methodo- 
logy, etc. The APA (American Psychiatric 
Association) file fs composed of ab- 
stracts and bibliographic data which 
eventually 'wl 1 1 become part of the NCHHl - 
file. The Drug Abuse Information 
System (DAISY) Inclutdes abstracts and 
bibliographic data, copied From some 
of the other files, which deals primarily 
with drug abuse problems. The Drug 
Abuse Program Oriented System -(POSY)'" 
Is a fjle composed of^Jn format Ion on 
drug abuse treatment facilities and 
other drjug^'^fe^lated organizations nation** 
wl^e^^ These five files ar* updated 
"fess frequently than the general NCMHl 
file which Is updated continuously. 



c) Basically, ERIC is considered to 
be the '^yherewl thai" for developing 
and maintaining selected RsD and R&D- 
related reports, A study is underway 
to evaluate user needs and to develop 
alternatives to the present file parti- 
^ tlons, so that the ERIC files can be 
more useful to practitioners. The * 
use of a thesaurus as the controlling 
access mechanism for ERIC has crc'ated 
some problems. For example, some terms 
change meaning:, over time and some have 
different meanings for different groups; 
some of these J^sues are now being 
explored In a contract to LEASCO, 
Another problem concerns the standard- 
ization of Indexing, To Insurt that a 
given document Is not processed more 
than once,; each Clearinghouse Is 
assigned a' specific domain of cover- 
age; the scope of each Clearinghouse 
Is then broadcast to the others and 
overlapping documents are routed to one* 
place for final processing. 

In addition to RIE which covers 
research-based literature, the Clear- 
inghouses produce another monthly 
abstracting and indexing journal called 
Current Index of Journals In Education 
tCIJEJ which cove rs the'latest devel op- 
ments in journal articles. CUE also 
has an annual Index, The -Clearinghouses 
decide on the j ournals to be covered, 
although the contractor creates the 
indexes and abstracts of the journals. 
There are three types of journal coverage 
cover-to-cover coverage of selected 
journals; articles periodically selected 
out of other journals; and some journals 
covered on a "one shot basis." 

Increasingly, the USOE-sponsored 
RSD centers and laboratories are develop- 
ing dissemination mechanisms of their 
own which are available to KCEC staff. 
The centers are establishing an Informa- 
tion system which wi 11 al low access on 
a topical basis. A catalogue is being 
produced which will have a -project 
description of ail products coming out 
of the Labs. 



-169- 



mximal DiU Sj^Btm 



d) *f t les and stores all docu- 
ments in the knowledge 
base iii a manner which ^ 
allows access to and 
distribution of any docu- 
ment at any tim 
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d) The Division maintains an In-house, 
manual system of storage and access » 
which generally allows them to proyl^e 
documents at at>y time. Staff also 
maintain storage of older material for 
some purposes. The DOL library Is seen 
as a dtstrtbution point for some ORD 
information. Final reports are routinely 
processed Into the National TechnUal ' 
Information Service (NTIS), and a 
, complete set of microfiche copies of ' 
all reports stored In bcth NTIS and 
ERIC It being asstnbled. 



d) RUB has made arrangements to have 
all research documents stored in NTIS 
with microfiche and hard copy capa- 

' bility. They have also developed an 
SRS-Midc Information system. Including 
abstracts of all projects from the 

■ RSD program. A contrq^ct Is presently 
Ir. negotiation to establish the soft* 
ware elements for a computerized 
system, and an existing contrac^c is 
berng renegotiated to include more 
information in the system, specifically 
R6T Ccntcr_abs-t-f^cts~and projects In 
SRS'"Research for which there are no 
enisling abstracts. Requests for 
material on specific subjects are 
also processed by one of the staff 
in RUB, but searches must be done 
manual ly . 
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Thus, the Clearinghouse has assumed 
the role of maintaining the knowledge 
base on mental health even beyond that 
of Information generated by NIMH re- 
search. Given the nature of some of 
its files. It also has begun attempts 
to catalogue and store documents 
separately for particular audiences, 
e.g., those people concerned wUh drug 
abuse. A Clearinghouse on alcoholism 
is planned for the future. The various 
bibliographies on specific problem areas 
also come from this knowledge base. 

Even with this base, however, there 
have been complaints that the abstracts 
included In the NCHHI have been of a 
highly "technical" natu.. and that the 
tecnnlcal nature of the Information has 
limited the use of this base to research- 
er-profess fonal communities. 



d) Although the Clearinghouse has ab- 
stracts and microfiche of relevant 
journal articles and other documents 
stored in Its Information base, It does 
not actively disseminate these. Thus, 
clients may find It difficult to obtain 
a specific research report desired. 
However, there Is a documents center 
fron which the public can purchase 
copies of fn-house products, e.g., the 
Syntheses produced In OPPE. OPPE It- 
self recently established a Documenta- 
tlor Center where copies of the eval- 
uation reports can be read, although 
there are no copies presently available 
for purchase. Eventually, OPPE plans 
to send these eva 1 uat I on reports to 
the Conine rce Department Clearinghouse 
where copies can be purchased by 
anyone. 
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d) ERIC Is designed expl Id tly. to ful- 
fill this function, assuring monthly 
updating and access to knowledge through 
batch processing. The Educational 
Reference Center <ERC) does provide 
Interactive access for OE staff, but 
this Is not generally available to 
practitioners. Sonw users are picking 
up ihe ERIC data base for .further 
dis'iemlnatlon, e.g* , In Hontgomcry 
County, Maryland, chey have developed 
their own Information system with all 
of the ERIC files on hand. Other local 
agencies have also done this. 

The abstracts ^nd indexes of the 
journals covered by the Clearinghouses 
are published In CUE monthly by a 
private firm, and the abstracts that 
go to GPO are used fbr the monthly 
Journal RtE . The original documents 
or. which the abstracts are based are 
sent to another contractor, the 
Educational Document ; Rep roduc I ng Service, 
where they are put onto ifllcrofiche and 
hard copy, assuming there Is no problem 
with the copyright. One non-NCEC 
respondent felt that BIE and CUE did 
not provide sufficient information as 
to what is tr the ERit information 
system. 

E'T.ewhere in 0E» there have been 
various library uniti. and reference 
units set up. For example, some of i^e 
research coordinating units (HCU) spon- 
sored by the Bureau of Vocat i ona 1 - 
Technical Education hai/e set up "satel- 
lite centers" where there are ERIC- 
type reading rooms within drlvi*ng 
distance of every vocational district 
In the state. 
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c) files and stores access 
information to all know- 
ledgeable persons for 
relevant topics 



It is important to 
note that storage is a nec- 
essary prerequisite to 
transmission because of both 
the limited capacities of 
information channels and 
the necessary dysynchronl- 
zation of knowledge builders 
and knowledge users. The 
means of information storage 
in this age of technology 
are many and include audio 
and video tape, punched 
cards, films, and computer 
menlory tapes, drums and 
cores. Nevertheless, the 
primary knowledge base is 
still mostly stored and 
transmitted In two modes: 
written and spoken words . 
Therefore^ whatever other 
storage capacities a D&U 
System may have, it must 
have a complete written docu-- 
ment storage capacity and a 
spoken word storage capa- 
bility. 

Spojjien word storage at 
this st^te of available 
technology basically means 
human lira in storage, having 
on fi/e and fn memory the 
namcy, addresses, and 
telephone 'numbers of people 
who/are doing research and 
development work and/or 
have read, listened to and 
absorbed knowledge from the 
knowledge base In specific 
areas. 



M,A. DivieCon of R4D Utilizatim 



e) The annual Manpower R&D Projects con- 
tains an author index; otherwise, there 
is no comprehensive cataloguing or 
filing of resource experts. This happens 
inforroaUy, however, and on a decen- 
tralized basis. For example, each of 
the Division staff meprbers Involved 
in special sub-areas of R&D on manpower 
have informally accumulated mailing lists 
of people Interested in the sub-areas, 
as well as lists of people with exper- 
tise in these fields. Some of ORD's 
contractors also maintain lists; for 
example, the Experimental Manpower 
Laboratory for Corrections at Montgomery, 
Alabama, has developed a card file of 
all visitors and a mailing list of those 
Interested in this correctional field. 



SB$ fieaearch Utilizati^'n Bra*u*h 



e) SRS Research does not contain an 
author index, there is no cataloguing 
or filing system for researcher sources, 
although some of the bibliographies 
developed on a decentralized basis have 
an author Index, e.g. , tine B ib I lography 
of R&D Reports produced in Florida. 
However, RU8 has developed a directory 
of rehabilitation consultants. The 
Division of Research ana Training Centers 
has also produced a training directory 
of its Centers. 
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OR National Center JVv Sducaticnal 
Camunioation 



e) A few directories have been developed 
in NiMH which cite. various resource 
groups: there is a' directory available 
on the local mental health centers, as 
well as a rural mental health directory; 
the POSY file in the Clearinghouse docu- 
ments all of the drug-related facilities 
offering tr-^atment nationwide; one of 
the programs In the Division of Extra- 
mural Research has developed a contract 
designed to list various private funding 
sources for research support. However, 
there Is no present cataloguing of the 
various research and resource personnel 
available for the whole NIHH system, 
although the sources of various docu- 
ments Included in the NCHHI information 
system may be searched. 



e) The Dissemination Programs Branch 
has tallced about preparing directories 
of experts or consultants around parti- 
cular problem areas, although they have 
not yet done so due to lacic of funds. 

The RCUs of the Bureau of Adult 
Vocat lonal -Technical Education maintain 
directories of all vocational guidance 
counselors, all electronic teachers, 
etc. At the yearly RCU meeting, the 
Directory of RCU's is updated and then 
reproduced so that everyone In the 
field can Iceep abreast of their counter- 
parts . 
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the iMxirMl D^U 
system both the written and 
spoken storage mechanisms 
wHl be thoroughly Indexed 
for retrieval but they win 

effectively cross-indexed 
a^d referenced so that 
written and spoken sources 
can be matched easily. This 
cross-referencing Is very 
Important for a number of 
reasons: (a) It makes both 
storage systems much more 
accessible, (b) It allows 
cross-validation of informa- 
tion, and (c) it Increases 
-the number of alternatives 
for channel use in linking 
resources to users (see 
section k.2k below). 



CHANJJELS: The pathways 
by which information 
can travel from the 
R&D community to users. 

The maximal D&U system 
should have regu tar ly used 
and efficient channels of 
cofinun icatlon established 
for both written and spoken 
messages and for both KOrmaT 
and Informal messages Between 



themselves and 
a) researchers 



Af.A. Div-Uion of UtiliMQtion 



a) There are good contact relationships 
established between the utilization 
unit and many researchers through pro- 
ject monitors In DRD and through the 
"buddy systenf* which links utilization, 
specialists to projects from their In- 
ception. In fact, of course* this 
represents a channel to a very small 
segment of all the researchers in the ^ 
U.S. who have potential ralevance but 
probably Includes those who have high 
Interest and expertise in manpower 
problems* 



SRS fteaearah UtiliMation BiMtu^fh 



a) There Is not a single research com- 
munity to which RUB could link, but 
several different groups represented 
in the numerous research areas supported 
by SftS. Thus, RUB has not yet establish- 
ed a system to touch bases with the 
universe of relevant researchers. It 
appears that different functional groups 
In SRS have identified their own "experts 
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OS National Center for Sducatijnal 
Commnioation 



a) There is a wide range of research 
coffiTHjni t ies with which various units in 
NIKH interact, and the specific com- 
munity for each research program appears 
to vary. However, It was evident that 
there wrre a number of good channels 
available to all of the units for the 
exchange of information with researchers. 
Many NIHH staff members who are pro- 
fessionals In specific disciplines, e.g.» 
psychiatry, are encouraged to maintain 
professional contacts with other re- 
searchers through membership and parti- 
cipation in professional organizations. 
The heavy emphasis on consultation with 
researchers In the development of re- 
search projects aMows a readily avail- 
able channel. As one respondent stated, 
"there ore between 200-300 professionals 
in the different sub-systems within 
NIMH, and they are constantly consulting 
at universities, centers, etc." Some 
of the research programs, e.g^i the 
Division of Extramural Research, have 
cited tho ute of conferences t..at they 
sponsor to provide exchange. The 
peer review committee also provides a 
readily available channel to a smalt 
group of reteftrchers. 



a) NCEC staff have found tt important 
to maintain both formal and informal 
contact with researchers. They get 
Input through informal meetings and from 
groups like the American Educational 
Research Association (AEIU) and their 
own Research Advisory Committee. Through 
the comprehensive literature Indexing 
of eAiC, NCEC has the potential capa- 
bility for identifying researchers by 
Interest, specialty, geography, etc. 
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b) pol icy makers 



c) practitioner-professionals 



M,A, Division of RiD Wilization 



b) it appears that there is 9ood:.upward 
communication to policy people via 
written channels. The 1971 Manpower 
Re^rt of the President contains about 
25 references to ORD-sponsored work and 
we understand that this document is 
widely circulated and used In the 
executive and legislative branches of 
government. All final reports are 
screened for policy relevance and when 
warranted are brought ^o the attention 
of the Assistant Secretary of DPE and 
ASPER through Advanced Research Briefs . 
R&D Summaries (containing two page 
summaries of reports) also may single out 
the relevant R&D; the Summaries ^o to 
staff assistants of policy makers. 

Informal and personal'' as well as 
formal and written channels are used. 
In one cited Instance, a researcher was 
brought In to discuss his study with 
the Secretary of Labor. Such Instances 
as briefings, meetings with task forces, 
etc., give evidence that the channels 
are available, whether or not they are 
frequently used. 



c) There are no direct official channels 
of communication to Manpower professionals 
except through thng administrators of 
state agencies and their federal counter" 
parts in USES and OEDP; this Is an 
extremely cumbersome chain of communica^ 
tlon. Some USES and DEDP staff recognize 
the responsibility for research ut 1 1 Iza- 
tion, but most appear to be under little 
pressure to utilize results themselves 
or to pass them on to the regions and 
s'tates; yet direct ORD contact 'With 
state agencies Is frowned upon. 

The only effective links today seem 
to be through experimental and demonstra- 
tion projects themselves or their spin- 
offs to larger programs under federal 
control (e.g. , NYC) . 

Links to USES and OEDP are often 
made on an informal ad hoc basis, some- 
times by visits from D&U unit staff 
hand carrying documents of apparent 
relevance. Such a personalized approach 
has Its merits but clearly misses, in 
terms of comprehensive coverage, re- 
liability, and perhaps cb'iH-effectlve- 
ness . 
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b) it appears that there are formal 
channels for upward communication via 
written materials. However, the 
channels from the policy makers down- 
ward do not appear to be as clearly 
established. The RAl/B In the Intra- 
mural research program earl ler had 
performed the function of highlighting 
relevant research with policy impli- 
cations, but this function has not been 
clearly assigned to any single unit 
since the demise of RAUB. In-house 
task forces and commi ttee\ meet Ings 
serve as potential channels to relay 
research Information, but are not 
regularly used for this purpose. 



ERIC 



c) RUB has recognized the difficulties 
in setting up channels between the 
central office and state and local 
client groups, given the cumbersome 
ch^ln involved. To set up a "bridge,** 
the nine RU Specialists are operating 
In a state setting. RUB has also used 
the Specialists as a sounding board to 
test out new Ideas, although the 
effectiveness of this link has not 
yet been- evaluated. 

Links to the federal administra-: 
tors themselves are effective to vary- 
ing degrees. Some in RSA have been 
tied In very clpsely with RUB through 
f.peclfi«; project or program efforts. 
.For example, the program of Public 
Assistance In Vocational Rehabri 1 i tat ion 
(PAVR) , linking RUB, program people, 
the RU Specialists, and an RU lab,- 
has proven that such a network can be 
established. Yet, as one mo^/es away 
from RSA with which RUB has closely 
worked, the channels are not so well 
established.' Some of th» other program 
people still have informal ties to the 
research programs that were formerl.y 
In their bureaus; yet the program 



ffim Mental Health Services Development Branoh 



b) The most coovnon channels to policy 
makers that were cfted by staff members 
in the various units Include forma), 
written channels such as budget just I- 
flcations and planning documents, as 
we') as participation on In-house coiwnlt- 
tees and task forces which convene around 
specific problem areas of concern to 
in-house policy makers. Staff In the 
Offices have used channels to policy 
makers, more frequently since their pri- 
mary responsibility Is to this client 
group . 



c^ The availability of channels to the 
Rcgiotial Offices appears to vary across 
units In NIMH. The MHSV and Its larger 
MHS Program Division have attempted to 
develop close ties to the regional staff, 
given that the Regtchat Offices have 
clearly defined acces^j and channels to 
the states and locals through their 
monitoring and administrative duties. 
Whenever a MHSV staff member goes on a 
site vUit to a specific mental health 
center, he works In collaboration with 
the regTonal and state staff; they often 
make the trip together. The Branch 
and MHS Program Division recently con- 
ducted a conference which included 
regional staff members and the "cadre" 
of experts In the children's area. 
At this conference, various issues were 
discussed which related directly to. 
central -reg I ona^l relationships : how to 
develop vehicles for providing on-going, 
updated information between the regions 
and the central office and how to gather 
and exchange information from the field. 
Complaints of overlap of information and 
"unsystematized" information and con- 



OS f/ational Center for Eduoational 
Ccmnunioation 

b) Therfe are Informal channels to the 
Deputy Commissioner to solicit support 
for NCEC; such support Is important to 
advance the interests of NCEC in meet- 
ings with other CE Deputy Commissioners 
on budget trade-offs. The examiners 
and evaluators such as those employed 
by the Office of Management and Budget 
were viewed as accessible and NCEC 
staff make a point of presenting in- 
formation to them, indirect contact is 
achieved through the preparation of 
budgets, reports, guidelines and posi- 
tion papers, and Congressional corres- 
pondence, fe.g. , a Congressman may ask 
about a specific constituent's project 
being funded or about general infor- 
mation. However, no direct contact 
was cited with Congress or policy makers. 
Time Is also spent writing justifica- 
tions, working on crash assignments, 
and in liaison activities. Meetings have 
been held with policy people for help on 
particular programs and some NCEC staff 
members are called upon to give advice 
on D&U. 

It would appear that NCEC has 
had relatively good access to middle 
level policy makers within USOE and 
advice Is constantly sought on both 
sid«3 via both personal contact and 
written memoranda. 



c) In trying to promote change in educa- 
tional practice, NCEC staff concentrate 
their efforts on state educational 
agencies and work in conjunction with 
■them. A few programs are given addi- 
tional money to set up demonstration- 
visitor center sites where workshops, 
training sessions, and technical con- 
sultant services are offered by project 
staff. In the Exemplary Progi^ams and 
Practices area, contractors will evaluate 
practices and programs of particular 
priority areas; such practices will be 
validated, and demonstration centers wi M 
be s«t up at the sites where the most 
effective practices are found. This 
type of "validating" procedure is 
exemplified In a project in which ten 
model reading prografmrTiive"been 
selected from 100 for further dissemin- 
ation; three of these ten programs have 
subsequently been set up as demonstra- 
tion sites. Project staff on the sites 
split their time between on-site 
demonstration work and consultation 
work. They may use funds for holding* 
workshops, training sessions^ and the 
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Generally speaking, sinc« USES and 
ORD staff know each other on a personal 
basis, the basis of a good relationship 
exists, However* functional » organiza** 
tionalf and geographical separation 
make this Mnkage excessively difficult. 
The added fact that under decentraliza- 
tion USES and OEDP have little control 
over what state employment services 
choose to do, makes communicatton of 
research findings to the states through 
bureaucracy very difficult. Staff in 
the Division are increasingly realizing 
the Importance of Unking to the state 
and regional offices, given their added 
power and autonomy. Yet a study con- 
ducted last year In the Office of the 
Deputy Manpower Adrslnistrators Indicated 
that the regional offices knew least 
about OPER (Including ORD and OPE) of all 
the Manpower Progratns. 

On the other hand, there Is regular 
input to various levels of professional 
practitioners vfa the "Manpower Research 
Visibility" section of the Amcrl can 
Vocational Journal and through Manpower 
Magazine . We have no knowledge, however, 
of the likely Impact on readers. 

Another tactic in developing channels 
to users Is to employ certain user groups 
themselves In promulgating or- developi ng 
findings (this strategy has been called 
"uti'izatton by subversion"). Examples 
of such contracts sponsored by the 
Division include the contract with the 
American Bar Association (ABA) In 
which ABA Is promoting the results of 
an earlier law study; the National 
Civil Service League (NCSL) is contracted 
to develop new model civil "^-vlce laws 
and'to stimulate public hiring of the 
disadvantaged In the new emergency 
public service program. Both of these 
contractors are professional organiza- 
tions outside of the Manpower Administra- 
tion. 

Recently, the Division has been 
encouraging the use of media o^her than 
print to develop channels with greater 
potential impact. Manpower Science 
Services, under contract, is translating 
written materials into cassettes and 
films for self-Instructional courses to 
be used by practitioners. This is, as 
yett being done on a limited scale. 
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people have been under little pressure 
to utilize the research results of 
ORD themselves or to relay such re- 
search to the state and regional pro- 
grtams. Some respondents felt that 
there were no "rewards" for having 
such a commitment. 

Some ties with professional 
organizations such as the National 
Rehabilitation Association and the 
American Foundation for the Blind have 
been established through project fund- 
1 ng. 

It is noteworthy that RUB has 
been experimenting In-housft develop 
a new channel, particularly to the 
practitioners. A staff member is 
presently developing multl -media 
techniques to relay information. To 
date, experiments have centered 
around audio-visual product ions based 
on selected RSD Briefs . However, pro- 
jects considered in the future ijictude 
the development of a "moving audio- 
visual van" experiment. This van would 
travel to various local agencies and 
present Information on current SRS 
topics via motion pictures, slides, 
pamphlets and other media. 



• 
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NIMH Mental Htuilth Senncea Dei^eicpment, Branch 



0£ National Center for Sduoational 
ConvTuni cation 



tacts which come from the central office 
to the Regional Offices surfaced at 
the conference* indicating that an 
efficient NIMH-wtde channel has not 
been developed yet for all of the NIMH 
programs . 

Channels to the various professional 
groups appear to be developed by staff 
members through their participation 
in professional associations and con- 
ferences; these channels vary across 
the agency, depending upon the particular 
definition o7 clients. However, channels 
to practitioners are not developed among 
all of the units, and the extent of^ 
these channels appears to be based 
the orientation of the specific units. 
For example, the MHS Program Division 
has been described as being "vertically" 
oriented, with staff using consultation 
as a channel to practitioners. On the 
other hand, the Division of Extramurat 
Research has been described as being 
very "hor I zon ta i ly" or I ented , with most 
channels open to researchers and not 
to service personnel. 



development of manuals and other pro- 
jects. The Dissemination Programs 
Branch, which has been responsible for 
such projects, has developed Some of 
the general publicity materials for 
the sites originally identified and 
has distributed them nationally. 

PREP output Is also used for con- 
ferences and workshops with state 
agency people as a means of reaching 
the practitioner, as are the Exemplary 
.Practices InstaUation efforts , and 

■ the Educational Products Display. 
When the Display Is brought to a site, 
consultants from the Ubs and R&D centers 
who itnow the products being displayed 
accompany^ the exhibit. Personal 
consultation with staff members of the 
Educational Materials Center (In the 
lobby of the OE building) is given upon 
request. The primary purpose of this 

'latter display Is to exhibit school 
materials produced by NCEC, other parts 
of OE (e.g., OPA) , professi ona I associa- 
tions, and commercial firms. 

One channel NCEC uses to pro- 
fessional associations is the maintenance 
of an "invisible college^ network" to 
insure that they are represented at 
major conferences and professional 
meetings. Staff members have served 
as resource people for such organiza- 
tional meetings as AERA, the Association 
for Supervisors of Currlculun Develop- 
ment, and the American Association of 
School Administrators, and workshops 
have been conducted to develop a general 
awareness of ERIC^ an awareness that Is 
felt to be a problem among practitioners. 
All of the Clearinghouses answer ques- 
tions and send out newsletters which 
report on the latest developments and 
issues. The Clearinghouse staffs have 
close associations with their pro- 
fessional groups and many staff members 
have columns that appear In professional 
Journals. However,, it was felt that 
there have been too few products created 
by the Clearinghouses which are directed 
toward the practitioners, such as how- 
to-do-I t manuals . 

The Copyright Program was made 
a part of NCEC because the function Is 
considered to be a part of dissemination 
which transcends any Bureau. \t facili- 
^ tates channels to practitioners by 
allowing developers to make money and 
by bringing In private sector distri- 
bution channels, The programbegins 
where ERIC leaves off; it Is Intended 
to facilitate publicatlofi and wide 
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d) consumers in their field 
of concern c 

and 

e) the general public 



M,A. Dioiaion of HAD UtiiiMation 



d.) No sustained Inf ormatfion channels to 
trhe unempi oyed , hard- to-employ , under- 
Employed, or job seekers are apparently 
available, because this function may be 
assigned to the Hanpower Administration's 
Offict f^f Information. However, In 
some cases, specfa) mal louts have been 
conveyed, with a cover letter,^ to seg- 
ments ^f this group, e.g.', maUouts based 
..^on the "Study of Negro Employment In 
the South" were sent to 125 people in 
WemphJs, Tennessee, 
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-d) No dfcre<-t Information channels have 
been established by RUB to the disabled, 
the eiderly, public assistance cUlSnts, 
or C her needy ^potential users among 
SRS client populations, although ?^ome 
audlo'Vi sual productions have been 
prepared by other pa-rts of the organi- 
zation. 



NI^ Mental Health Serviaee Develofment Brcoiah 



OE Natioruil Center frr Educational 
Ccmunicattcn 



d-e) Given that one of the missions of 
NIMH includes the prevention of mental 
i)lnes5, the consumer group*^ In this 
case would Include the general public, 
For this group^ sev^ieral channels have 
been developed within the Office of 
Commua i cat ions , Short television and 
radio "commercials^* have been used 
periodically to alert the general pubUc 
to specific mental health problems. As 
noted earlier, a contract sponsored by 
the CleaVlnghouse recently iias begun In 
which 20 Fact Sheets will be developed 
for the general public on sjelecttd n«nt«l 
health problems. ^b 



dissemination of 0£'subs idl zed R&D 
products and materials, e.g., audio- 
visual packets which cannot go into 
ERIC as well as "thick" books thai are 
too big to put into ERIC. The decision 
of where to put the product (In ERIC 
or the Copyright Program) is left up 
to the developer. The Publ ishers Alert 
Sys tern ib designed to assist developers 
in f i nd f ng appropriate commercial out- 
let^ for their products; if a developer 
has a product that he wants to publish, 
he flHs out a form and sends it to 
the Copyright staff. The form Is then 
turned over to a contractor who pre- 
pares an announcement and sends this 
announcement to publishers. 

Some important D&U activities take 
place outside NCEC, The Bureau of the 
Handicapped is setting up a national 
center to disseminate curricula and 
other products of their Bureau; they 
also have "media centers" for dissemin- 
ation purposes. The Education Innovation 
Falr» sponsored by BESE , h?s Influenced 
a few states to conduct fairs on their 

I *.'_9.*. t_ the New E ngla nd Reg i ona 1 
staff have met and presented projects of 
their states to other states. Annual 
reports to the states have also pro- 
vided some "cross fertilization" among 
states. In the Bureau of Adult Voca- 
tional-Technical Education, some of the 
RCU's print and disseminate booklets 
to all of the school districts in their 
states. These booklets highlight 
materials that have appeared in ERIC and 
note how and where the documents aVe 
available as well as adding things with 
a "local flavor." Leaflets developed 
by some RcU's on the latest studies 
for particular groups include t/\e 200 
word abstract produced by their Clearing- 
house, The abstract Is put into their 
quarterly journal, ARMS , which goes out 
to the states; the journal also contains 
abstracts of completed reports In this 
research program. Oi sseminat ion also 
occurs to the professional groups. 



d-e) NCEC has little direct contact 
with the'publlc, parents, or students 
apart from the exhibits and book dis- 
plays which are located in the lobby 
of the OE building. Primarily, the 
Office of Public Affairs has this func- 
tion. 
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f) they should be able to 
build such channels bet- 
ween researchers and their ( 
knowledge base and these 
various audiences 



k.lS TO WHAT EFFECT : The 
acceptance and incor- 
poration of the message 
by the receiver, 

The maximal DSU system con- 
tinuously monitors user 
audiences of all types (poli- 
cy ,. producer, etc.), to 
determine If communicated 
knoMle<ige Is being secured 
an*d used and to evaluate the 
effectiveness of messages 
and channels. It also 
should be able to use such 
evaluative int-ormat Ion to re- 
des i9n the system of O&U. 



'M,A, tnvieion of HiD Utilization 



e) Press releases were cited as an 
let for important findings. 



f) The Division of RSD Utilization puts 
special emphasis on bringing researchers 
together with both decision makers and 
practitioner-professionals at the point 
at which their findings are becoming 
available. Sometimes contracts are ' 
given for the arrangement of such con- 
ferences. For example, the Brookings 
conference brought together researchers 
and users to discuss findings of the 
WIN programs. A model developed for 
another type of conference was exempli- 
fied in the University of Wisconsin 
conference involving regional and state 
employment service and mental health ' 
staff, with technical assistance foHow 
up provided. to participants after the 
conference. Efforts are made to target 
these contacts on an ad hoc basis. Much 
energy goes into thef^e efforts at person- 
to-person linkage, and they probably are 
effective in building a network of sorts 
between the research community and some 
of the practitioner audiences; but, 
coverage Is bound to be far short of 
the total . 

The Division has also developed 
the strategy of using -researcher^ as 
consultants or "purveyors" of technical 
assistance to user groups in such pro- 
jects as Work Sample As&essment/ NYC 
Goes to College, and Youth Tutoring 
Youth. 



e) Under the auspices of "Project 
Alert," a channel has been; set up *n 
which timely pieces of research infor- 
mation will be sent from ORO to the 
Office of Public Affairs {CPA), and 
from CPA to the rnass media. I.e., 
news releases, television, radio, In 
conjunction with OPA,i an RUB staff 
member has developed a television pro- 
gram, video tapes, and other materials 
suitable for a general audience. 

f) RUB builds these channels in two 
ways: (l) by planning and sponsoring 
conferenaee yrt\X.\:\ users and researchers 
In attendance (four during 1971) and 
(2) by fundi ng researchers to serve 

as consultants for clients. An 
example of the latter Is the project 
at the University of Wisconsin RRRI 
in which a "Visiting Project Director" 
will serve as a consultant, in general, 
all of the RRRI's are mandated. to 
provide consultative services to the 
state cl lents . 
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The Division does not monitor audience 
reception, except in the n^ost Informal and 
limited way, generally where^persona I re- 
lationships already exist. The Division 
informally does get some Indicators of 
audience reception in the following ways: 
through evidence that findings have been 
incorporated Into programs, .general practice, 
or legislation (a chapter In the Breakthrough 
compendium was devoted to a discuss Ion of tne 
influence of R&D findings pn legislation 
and^.the RSO Chapter of the 19^® Manpower 



in thje past, audience reception has 
been monitored by RUB; in various Informal 
ways: by obtaining coWnerts from program 
staff on specific research reports; by 
using the RU Speclansts as sensors and 
also obtaining thel/r opinion and feedback 
on various experimental efforts; also by 
asking the reader^ of the Briefs via written 
questionnai res J f/ they want to ccntityue 
receiving them, /However, ;onie formal eval- 
uative efforts have been planned In the 
1972 R&D Strategy. RUB is sponsoring an 
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f) There have been scattered efforts 
to build channels betwe^Sh research*- 
and pract I t lonerb , although there was 
some ccnccrn over the tack of channels 
even between the bas^c and niore app^ ted 
researchers themselves. The MHSV has 
begun to use administrative supplements 
to allow the grantees to hold speq,lal 
conferences and to provide active 
consultation to other potentiat users. 

The Center for Studies of Narcotics 
and Drug Abuse has cfted the use of 
conferences ^n a few cases to bring 
practitioners and researchers together, 
although most of the co^^ -ences that 
this unit has sponsored ha^^e been designed 
for researchers themselves. The Center 
for Studies of Crime and DeMnquency is 
atrempting t6 build up pools of re- 
searchers end experts who wi M be able 
to provide technical consultation to 
practitioners in their particular areas 
of concern. However, s uch channe I s are 
just opening up and there has been little 
fundi ng aval lable for this consulting 
activity. 



The monitoring of the reception of 
various audiences to research-based informa- 
tion appears t6-.be done on a decentralized, 
informal basis. Several divisions cited the 
use of informal feedback from researchers as 
a means— of" men i tdri ng the adequacy of infor- 
mat ion . The Clearinghouse uses tabul at Ions* 
of Inquiries as a means of getting feedback 
for Its operation.. They «re also developing 
a user* re«ct ion form. ,' 



OE Nut ic**ial. -'^nr. r* ;V 
Comtunication 



Educational 



f) T^e use of workshops, training 
sessions, and technical consultant ser- 
vices for some sites may serve ci a 
channel between users and researchers. 
There ts a dichotomy between research 
and Instruction which has been a matter 
of status, wfth sanctions built in for 
crossing the line. Historically, there 
has been no, ef f eci: 1 vc channel for 
communication between researchers and 
practitioners; "researchers talk to 
researchers." 



in KCEC, there are evaluation studies 
being conducted of the Pilot State Dissemina- 
tion Program, on the Educational Products 
Display, on ERIC, on varfbus programs and 
(Products of the ClearlnghoaseSn on the 
Exemplary Reading Practices, and on the 
Educational Communication Program. Present^ 
lyt there Is no formal mechanism set up to 
get feedback from users, although it 
was f«lt that the ClearingKiouses could do 
more of this if so funded. The extension' 
tgentt are expected to serve thfs function: 
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Report a Uo discussed this topic); through 
the presence of discussions on RtD in user 
orgdn-s , Such as in the Employment Service 
Let^tcrs iind in the many specialized niagazines, 
ai-^o by the number of requests they receive 
for infornrwt ion end reports. 

Specific projects have been designed to 
itudy user impact. For example, a pait of 
the contract for developing the "Research 
Visibility" column in the Ameri can Vocat i onal 
Jou rna I requires that a user-inpacl survey 
be done. The Experimental Manpower Laboratory 
of Correct ions has also tried to survey users 
and to dnaW^e of its projects on a 
decentralized basis. 



•valuation of the effectiveness of the RU 
Specialists. A nationwide sample study is 
also planned to obtain users' perceptions 
of the usefulness of the Briefs . In 

addition, RUB has proposed a field vali- 
dation study of projects which have been 
considered as exemplary or effective. 

All of the RRRl's have a responsibi- 
lity for evaluating the effectiveness of 
dissemination and utilization. For example, 
in Region 8 (Denver) , the RRRl has surveyed 
the whole region and maintains a feedback 
mechanism to determine what Information is 
seen as relevant by users. 

ORD is planning to become involved in 
"testing" the acceptance of research pro- 
ducts through their "management revi<»w 
process." They plan to produce findings 
from RtD projects which have relevance for 
program operations on a semi-annual bas.is 
and senr* these to agency administrators 
and policy makers. These administrators 
will then be asked what they have done, as 
heads of their programs, to implemenl the 
findings. A similar procedure has been 
planned for all of^*KEW at the Instigation 
of the Office of the Secretary. 
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«ow«v«r, i*^e «m5¥ h«v developed PT»ore 
format t%*^r\s fur mo«it»fin9 «u^^e'^ce recep- 
tion. 0'^ l^e terminal ion of projectb» t>i« 
Sranc*! •>aiic»l^ re^po'^MfS from project 
developers to now well t^ey t^^ink they 
have bee-5 served by the 8r«nch. At the same 
t'ipe, project director* are asWed to cite who 
an4 h(>« nany p^r%onv u»e th« preiect retuUs. 
Various esea'c^ projects have t>eeo Sponsored, ■ 
by iiir 0 MHcf to determine Kqw practitioners 
ut t I i /c «foriti»it ion 4^4 aKo tvi>r^ of 

protfct** jre ^est received by clients, fof 
enamplr* as A part of t'^e ^airweather project 
w*'nir^*< fk^. u>»<?c} f*'! ti^e Jeveiopment ©^"community 
iodge'^ Sf'fvicrs, the project director screef^ed 
variowv tafl i'«ej»*?*r% m ho^pita)^ to determine 
•<;-ft>er the ric^wlt* of projects were actually 
fce»'»9 wvtrd. Ar (n*how«e >tudy beinq conducted 
m ^notht r pji X o* th« WS Program Division is 
looking ,ti whjt information is ^01^9 %o the 
rieqit^p% htjM< thifc infcrmation coyttf fee 
-**ore precise. Vet in no part of NIhH does 
t'^ere aflt^ar to be a u'«it res-por-si ble for rh* 
i»Jo«4 tori ©f »^ie*»te receptican* at yar»©«s 
levels , 



«* the a^nts ^rk it> install inoovat'onj 
produced t)y Of .>r Ct-f^n^ed prvjecli, MUC 
^opti to «stabli-.h J »e*dbacw loop t>eiwf!«'n 
the I'^stai I in^.a^eno and ihv prodwciny a9ency. 
Throw^h^ haivon. NC£«0 (or NU) and ttje l^abs 
woyld theoretically be at»le qet rnformation 
from the agents drtd the retriewa) tenters on 
l^t s^Ps «n .r«kear<h and m their kno^-ledge 
bas«. In the Pilot States. feed^^^ck 
^as done on a clo>e reporting procedure, 
but It *»as felt fhai it wouldn't be possi- 
ble in a tar^^r system as it was even <tifft" 
cult when the ten ,iJdit ion'al ^tat* and locjl 
information centers m>re ♦ynded in th« 
'^Mot State Project. Alfhouyh there i very 
little feifdbacS. receiv^don an Gr9anired ' 
b«>is, soft* indication of recept iofi 4oe\ 
come in certain products, e,9.^ they can 
show how many schools have installed d«nion» 
strations and ha*?e spent money for it. 

NCEC is ne90tlat4n9 M4th the Office of 
ProQram Planninj s^^d €Malaati<im (OfP^t) on 
t*i« type -of e#alsiatii?« syste<» fc*r th#.jt 
enic«s iii>n systent; OPP£ want* to count the 
hun^r j^f t>eM products installed, whereas 
*C£C want's to cownt the number of people who 
tsk qijesttohs. AdditionaUy« ^ttC w*r\ts lo 
tr»cfuda other k(nds of evaluation indices 
such as counting "rational rejections as 
wins," Increased utllifation of the system, 
^nd Increased speed or decreased cost of 
adept ion of a new progran^ as evidence of 
Success. >io feedback is presently received 
f*om publishers concerning the Copyright 
frogram, althcvgh OPPE has teer» asked to 
fund a project Jhat wowld look at these 
comments and feedback; one respondent felt ' 
that Such a Study would be considered 
prici'jty« fiow<v«« . 

There U a contract with a Clearinghouse 
to tef.i vsev reactions to th* Educational 
''Materials Center and to a^sess th« ne^ds of 
the display visitors; these ^ata will also 
be used in a svb-contract to a design firm 
concerning a perrnanent display structure in 
the lobby cf the Ot building, flateri/.l {i^ai 
Is on display is not evalu^^ted by SiCtC staff 
members; instead, they try lo get public 
reaction to these exh i b i ts , tHC has con- 
tracted a study on QutRV users; aUhough 
they receive feedback from users of the 
search service, there is no formal system 
set up. Some of the of^er centers do solicit 
feedback by append* 09 bri^f <^uesticnna5Tf's 
to search request responses. €«IC schedules 
yearly meetings wish Clearinghouse people to 
share ideas and discus? problrems. Two e»/al- 
uation projects of CRIC product'^ are the sur- 
vey corripleted by the University of Indiana 
on the use of CRIC bibliographic tools and 
the contract with the Systems Oevelofnnent 
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k.}0 User Helping 

The man i ma I 061) system 
should be able to help users 
implement, install, and 
adapt 'nnovation^ based on 
R&O by training users In 
research utilization and 
resource retrieval. Addi- 
tionally, maximal OLU actl* 
vities should include devel* 
oping user openness and the 
capacity to accept change 
and RtO. (There is some 
overlap between user help- 
ing and "User Sel f -Serv ic rng, 
function Set 



M.A, Division H&[y I'ti LiMation 



The Oivtsion does not have any in'^house 
capacity for user helping beyond the referral 
to persons and print sources. It Is not 
clear whether ORD as a whole sees Uself as 
a "user helper" or not. In any case, the 
Division does i ot nave the resources to be a 
"user he ) per" beyond I nd I v I dua 1 , I n forma I 
cases 4 



SHS Mc 6 ear ah Uti liaatiori branch 



It Is clear that there is some concern 
In SRS to provide user-helping services to 
various groups. The new Office of Organi- 
zational Development will promote such 
capacity buMdin'i among federal users in 
SRS. The RUS's/lhe RUL's, and the RRRI's 
have some responsibilities to assist users 
In this manner at the state level by means 
of their consultative efforts and personal 
contacts. RUB does not have a major respon- 
sibility for this function and, given limited 
resources « expansion in this area is not 
likely. The role of RUB In this effort pre- 
sently fs more that of a linker to the 
various attempts that are occurring now to 
help users on a decentralized basis* 
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Corporation to evaluate the ''gualityj' of 
various ERIC publications. One rgsponJent 
feU that ERIC was trying to find out .jbout 
ustir needs by p^Kkagirtj t^e materKi) in 
the best ►/ay that they Know fiow to (ba^ed on 
D&U literature, etc..) and then learning from 
the reactions, repackaging, learning more, 
etc.. in a continuous cycle. ' 

There are attempts to make sure thai 
the dissemination efforts of NCEC are work- 
ing through an independent validation process 
included In the Operational Planning Sybtem. 
For example, in the EKCinplary Program Series, 
an RFP is issued for a validation contract; 
collaborative criteria development is done 
with the substantive Bureau i nvo I ved ; NCE C 
checks to see If the criteria is bein^ applied 
rigorously enough; and finally, the pi^ogram 
Is reviewed by an OE"wide dissemination board. 

In the Bureau of Adult Vocat lona I -Tech- 
nical Education, two studies done by out- 
siders were designed to (evaluate the RCU's 
operations over ihe tast seven years in 
terms of how well they have met their objec- 
t I ves . 



Although much of the work Involved In 
field consultation visits to mental health 
centers relates to administrative activities, 
e.g., moru tor i ng , MH5V and Regional Office 
staff also attempt.to provide technical 
assistance to the centers during these visits. 
The Children's Mental Health Task Force is 
aimed at Improving th'e knowledge for technical 
assistance on the part of NIflH and regional 
consultants, and a portion of the Human 
Interaction Research Institute project wiM 
be designed as a training project to enhance 
Branch staff members' skills in consultation 
to promote change. 

The Branch has funded a few training 
grants, and In one instance a training grant 
v(as used to fund a study on the training of 
mental health personnel in the use of operations 
research techniques. Staff in the Chi I dren ' s 
Menta 1 Hea 1 th a rea are set t i ng up local train- 
ing Institutes within centers with model pro- 
grams and are bringing in regional people. 
This effort was cited as the first Branch 
endeavor in the use of researchers and staff 
as a cadre to work with users; however, (t 
was not known whether the Branch would develop 
this activity on a systematic basis. 

Manuals developed by MHSV on how to use 
informal fon and on how to plan for creative 
change are designed to help users. 



"Developmental assistance" to local 
educational practitioners is pritnary 
goal of the extension system. Agents of 
the system are supposed to engage in problem 
diagnosis as well as knowledge linking and 
follow-up activities to help clients along 
toward the adoption and implementation of 
innovations and the utilization of research. 
The extensi*bn agents have held fxjrmal con- 
ferences to make people aware of informa- 
tion as well as workshops and consultation 
activities to go beyond just awareness. 
The local information centers, dissemination 
representati ves , and the demons t rat i on - 
visitor center sites are also part of the 
"national Unking syste-Tj" of NCEC to pro- 
vide technical assistance in planning and 
i fnp lemen ta 1 1 on of problem-solving efforts. 
Technical consultant services and training 
sessions are also utilized as channels 
between users and researchers . 

fn assisting other organizations in 
setting up their own information centers, 
ERC staff hope to provide consultation and 
t ra 1 n 1 ng ; s ta f f members f rom other centers 
h*ve been trained to negotiate qoestions 
and to provide help. As part of its Exemplary 
Programs and Practices program, NCEC has also 
sponsored ''installation" projects which in- 
clude such features as demonstratJon centers 
or t ra I n I ng places where I oca 1 school peop 1 e 
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SRS Reaearrh Utilization tiranah 
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win hav€ better access lo jnformaiion. 
Last year, ab a beginning, special installa- 
tion subsidies were given to -support installa* 
l ion of three i nmivat i ons : the MJnl-Course» 
ihe Mull 'i-Un il SchooK, and, the SWERL fcad- 
• ng friaterial^; there will be a few more 
funded this year. 

The Educational P roduc ts. Di sp I ay is c 
traveling exhibit of ten research-based, 
conme rc I a 1 1 y- produced products which is 
taken to about 20 or 30 sites a year. The 
exhibits Inciude aud I o- v t sua I displays and 
other products which ife into the priority 
areas of Ot . An array of alternatives are 
accompanied by R&O Lab and center consultants 
to help users decide which products could 
best serve ^s solutions to their particular 
needs. In ''pushing" educational products 
or Innovations^ staff members train educators 
to use the products. Publishers working 
through the Copyright Program often demon- 
strate their products at conventions and 
send s»ilesmen out to install the products. 
NCEC project officers also prov ; de ' deve I op- 
mental assistance to the project in terms of 
"technical advice" to project officers. 

Ohe of the unresolved issues concern- 
ing the extension system centers around how 
to train agents to be technically proficient 
demonstrators and installers for a large 
number of products; bringing in consul- 
tants and holding user conferences have been 
consluered, but there are problems of fund- 
ing and overload of information associated 
with those ideas. 

In BESe , program support packages have 
been developed that include visuals, hand- 
books, and documents regarding guidelines. 
The "Awareness Sessions" in<l "Adoption 
Clinics" of the Education Fair are designed 
to bring potential adopters and producers 
of Innovations together; staff members will 
fol>ow up by assisting the states with 
dissemination activities of their own. BESE 
"leases adoptions" through providing money 
to local demonstrations, bringing potential 
adopters to tie de/^ions t ra t ion sites» putting 
users In contact with peers who may provide 
assistance, and then offering a relationship 
In which Interested people can get technical 
assistance for installation efforts. 

One non-NCEC respondent expressed the 
view that presently there are no rewards 
for local school systems to accept innova- 
tions and there is a lack of financial means 
for the adoption changes. Additionally, 

although outside pressures for school t<rprove- 
ments may allow a climate in which RtD pro- 
ducts can- be marketed, these pressures also 
act as Inhibitors since thera may be built- 
in resistance to change. 

-189- 




Furct'on Set #5 

HICROSYSTErt BUILDING 



S.JO f nterchange 

TKe maximal 06\J system 
■^ets up many tVPe^ of 
situations in whic^^ users 
of an types (policy, prac- 
tice, consumers) can enter 
fnto (fnmedi'ate face^to- 
face dialogue wieh R6D 
P.prsonrel. These bituati"nns 
are distinct f ron\ meetings 
^et up for repor t i ng by re- 
searchers to a specral 
audience which would have 
the purpose of dissemination. 



5.20 Jser-Cot Taborat i ve RtO 



s I cm 

'A 

soWs 



The maKimal OtU system 
sponsors some projects 
which users and R^D pers6 
work as colleagues in all 
phases of problem-solving 
on a particular user need 
area. The situation in 
which the hlD person is 
himself a potential user is 
a special case of this user- 
coHaborative RSD. (This 
special case could also be 
subsumed under "User Self- 
Servicing," Function Set 
#1.) 



One of the earliest mode I s" assumed by 
the Division and others in Oi^D, and emphasized 
since, was that of netting up a system of 
interchange between researchers and potential 
users, as well as staff of the RSD program. 
Originafly, such inte r change sessions were 
organized on a forma! basis: two committees 
were set up, i^it^ one contalh'ing USES, BAT, 
O'^R , and other staff. Such meetings were 
carried out to promote face-to-face dialogue. 
However, thes^ tnl^rchange sessions are now 
conducted on a less formal basis. Seminars 
with researchers and staff of the M.A. were 
also conducted for 3 time as a source of in- 
service training; these sessions also set ved 
as a source of interchange. The purpose of 
this interchange model has expanded over 
time to include encouragement of active 
adoption as well as dissemination. 

Another medium sometimes used for this 
strategy has been conferences. To insure 
that interchange actually will occur and 
not just ' report i ng" by researchers, briefings 
and other materials are sent to participants 
before the conferences , and pre-conference 
meetings are held to discuss information 
needs of the participants and other strategies. 
Examples of such planning Include the WIN 
Conference conducted by the BrOOkings Institute 
and a series of sessions on the "manpower 
needs for national goals of tho 70's." 



The Division and other ORD staff members 
have consciously used this strategy. In the 
D i V i s ion ' s mode I of *'proj ects as diss em I na tors," 
user involvement is encouraged through the 
r equ i rement that utilization concerns be 
Incorporated into, the early stages of projects. 
Projects which focus on particular need areas 
have been designed to insure user participation 
in the development and funding of the project. 
Tor example, in a study contracted to the 
Bdttelle Memorial Institute on training needs 
of three Michigan cities, var'ious users were 
involved in project development : USES , 
vocat i ona 1 educators , the Governor ' s Of f ! ce , 
and HEW. 



Although not necessarily the responsi- 
bility of 'RUB, there are present or potential 
sources for interchange among RtD personnel 
and program people. Through the various 
I n- house task fo.rces and commf ttees, discus- 
sion and exchange of information could 
service both staff groups. The new manage- 
ment process in which "teams" of program and 
ORD personnel design the research program 
could also serve as a source of interchange. 
However, there may be danger of this proce- - 
dure not providing useful dialogue, but 
instead becoming a forma 1 i ty -- success may 
depend on the openness of those involved. 

RUB has been experimenting with the 
use of researchers "ion-demand and on-call," 
a technique adopted from the "Visiting 
Psychologist" program of APA. They have 
funded the University of Wisconsin RRRI to 
provide consultative services to the state 
Oepsi'tments of Vocational Rehabilitation. 
Some conferences planned by RUB may also 
provide a source of Interchange, though 
only on an occasional basis. Examples of 
such conferences that go beyond dissemination 
of specific project results would be those 
with a research utilization focus. Some 
of the RU Specialists have conducted RU 
conferences In their designated regions. 



The special case of the researcher him- 
self as a potential user Is important in 
the RSD programs .of SRS. It was f^lt that 
when users In the states perform the pro- 
jects themselves, they are much more likely 
to adopt the useful findings. The example 
cited was the Section lllj demonstration 
program of ORD, fn which single service 
state agencies can be the onfy recipients 
of the awards. By the time the project has 
ended» It was believed that useful project 
results have already been Incorporated into 
the state programs. 
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NCEC generally appears to have little 
direct invoWemenf in microsystem building 
between researchers as a whole and practi- 
tioners throughout the educational establish 
ment . Th i s is under s landab le , g i ven the 
size of the system, the limitations on the 
assigned mission ot NCEC, and the origir of 
NCEC as a print-based research informotlon 
collecting and disseminating agency. 



Trodi t tona I I y , the KHSV has assumed 
thai thf researchers themselves should 
have a primarv role in D&U efforts. In 
a few ccjses, to encourage the researchers 
to do so, they have funded grantees to 
hold special conferences on their projects 
and also to provide consultation to potential 
users ir order to provide a source of inter- 
change. It was noted that a few projects 
nave been funded in which researchers have 
set up training seminars or workshops on 
administrative and service concerns of 
the mental health centers. However, with 
the limited funds for encouraging this 
type of activity, the Branch has not been 
able to develop the full potential of 
these interchange situations. Within the 
Center for Studies of Crime and Delinquency, 
interest wps noted in promoting interchange 
between researchers and practitioners 
through the use of funding for consultant- 
typt services. 



Gra'its which the MHSV sponsor are split 
between tho.se to center-type researchers 
{i.e., mental health service personnel) and 
. UP i ve rs i ty - df f i I i at ed researchers. Among . 
the fornr^r type, there have been projects In 
which the producer-user has developed speci- 
fic tec*"riques ard '"■as spread such techniques 
to other potential users. For example, in 
a projec- cof^ducted b/ a Minnesota mental health 
center, j goal attainment scaliny instrument 
wai deve oped, The project staff are pro- 
moting this scaling device themselves through 
the deve opment of manuals and_ the establish- 
ment of tj network for subscriptions and 
monthly reports on scaling. An e^^ample of 



NCEC does not prorDOte interchange as 
a matter of direct and deliberate policy. 
On the other hand, it is undoubtedly true 
that the ERIC Clearinghouses, through their 
i nvo 1 vement in professional associations, 
do bri ng about many exchanyes between persons 
who can be defined as primarily "researchers" 
and others who could be defined as primarily 
"pract 1 1 1 one rs . " 

The function of interchange is undoubted 
ly carried out within many Divisions of USOE 
via special conferences and consultations. 
No a t temp t " cou I d be made in our study to 
enurnerate or assess theSi many activities. 



Within NCEC user-collaborative RtD is 
carried out through the Targetted Communic.i- 
tions Program. Researchers who apply for 
these small contracts ($^0 ,000-S50 ,000) arc 
supposed to involve users directly in form- 
ing specifications for the interpretation 
of and in shaping their final product via 
small conferences, consultations, or other 
means. 

Outside NCEC we are sure that many ' 
user-coUaborat i ve RtD projects are carried 
on altfiDugh we were unable to evaluate them. 
For example , many regional Laboratories and 
R&D Centers have over the years established 
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5 30 Integrated RDD&U 
Program 

The maximal DtU system 
sponsors programs in high 
need priority area^ in 
wh ich the f ul 1 cycle of 
probl em-sol V ing from need 
to integration of solution* 
is plartned, organized, and 
arranged to insure both 
relevant R&D and uti 1 i zat ion . 
This does not necessarily 
mean that one pr'oject or one 
project dir'jctor must en- 
compass this whole cycle; 
rather^ it can occur over 
time in a series of projects. 



The Division and other ORD staff have 
funded potent ia 1 users thcmsel ve'b to nandqe 
projects and disseminate results. An example 
would De the work contracted to the National 
Civil Service League (NCSL), a potential 
user organization of'lts own results. NCSL 
has developed a new model of civil service 
law with guidelines that could be used by 
local or state public agencies to enable them 
to h i Ve large numbers of unemployed, dis- 
advantaged people should funds become -avail- 
able. When the Emergency Employment' Act (EEA) 
was passed, this topic became a relevant area' 
of need, and NCSL provided needed guidelines 
for the EEA staff. A -need for a study such 
as the Work Sample Project was indicated 
by an in-house committee. This Work Sample 
Project was originally installed as an 
adjunct' to the -Ph i lade 1 ph i a Employment Service 
Office and was monitored jointly by USES and 
what now ORD. ' The model was then used 
on a much wider basis by USES. 

An earlier means to encourage user- 
collaborative R&D wcis the establishment of 
the EtD unit in USES from 1966-1968; the unit 
collaborated with the E&D program within 
OSMP (now ORD). However, this unit In USES 
no 1 onge r exists. 



The Expe r i menta 1 Manpowe r Laborator i es 
are examples of such an integrated program. 
The Labs are apparently set up in priority 
areas of need, such as training for the dis- 
advantaged, rehabilitation of offenders, 
etc. Such Labs look d i agnos t I ca 1 1 y at 
problems and design, experiment with, and 
test new techniques in an operational setting. 
The Laboratories also build on knowledge 
developed from earlier projects. Results 
of the nume rous e xpe r I men ts are p romu 1 gated 
by the various Labs by means of publications, 
conferences, newsletters, etc. and can be 
adopted for use in the larger manpower 
sys tem. 

The "buddy system" could also be a 
mechanism for this, assuming that the topics 
of research can be influenced by this system, 
that the researcher fv-lnvojyed via the 
"buddy system" unt i 1 his project~~is lrt+4-4-ze4i 
an*d that in the "buddy system" there Is some 
recall or feedback when necessary from 
previous projects monitored by the "buddy" 
and the project officer. Although not always 
through the "buddy system," some Dlvi-:iion 
staff members use theJr Iknowledge of sub- 
stantive problem areas to Integrate R,D, D&U 
efforts. 



^ The RU Specialism's have also oe*'^ m- 
folvisd in collaborative efforts. For " 
fcxaniple, results of a ^project on the deaf 

A^ere used by the HU Specialists and three 
state-level staff to plan small, user- 
oriented conferences at the state and loca-l 
level. ^ 



Perhaps the best example of this type 
of effort can be seen in the program of 
Public Assistance in Vocational Rehabilita- 
tion (PAVR) , in which projects completed 
over several years were picked up and 
integrated with new program p 1 anni ng , * i n- 
volvlng the users of many different levels 
in the planning and utilization as the new 
program developed. The Administration has 
been concerned with rehabilitation of the 
public welfare recipient for several years. 
This priority area was allocated expansion 
funds of $26 million, given the success 
of earlier demonstration projects. RUB 
then took the initiative and involved staff 
In RSA, the RU Specialists, and one of the 
RU Labs In several stages of program 
planning: the RU Lab In New York (ICD) did 
some field engineering and developed a topic- 
.centered clearinghouse in this area on 
rehabilitation of the welfare recipients; 
these groups were involved in a workshop to 
develop training guides regarding the 
servicing of this new client group; a 
national conference was held last fait to 
disseminate the training material. 



ERIC 



-192- 



d coUaoorat've type of project i'nvplving 
tne latter type of grantee i ^. ti^e project 
recent W initiated which will be cnnductetJ 
by the Anie^iian Institutes foV Research in 
collaboration with the National Counc4 1 of 
Cownuoity Mental Health Centers. This pro- 
ject' is designed to match solutions to 
problems which h'aye'beeh identified by the ^ 
Centers through their Na.tional Cc^unc i 1 . 



The entire MHSV Branch rs <>et up to 
integrate RDD&U around particular probleitr' 
areas. These problein areas were originally 
selected in-house, with the three-phased R&D 
process jsed to promote the quality of service 
in each of these problem areas: 1) identi- 
fication of need and problems for' change in' 
"services, 2} search and research to pro- 
vide direction for effective change to solve 
problems and rT>eet needs; 3) promotion {^f 
diffusion and adoption of ^ i nnovat'ons through 
planned change.* Thus, RDD6U are. encouraged 
around each problem a^d priority area of 
rhe Branch. One staff member noted his 
change i orientation from concern ^ver how 
researcn ideas could be "marketed" to a new 
approach: "let*^ go out and ♦iee wh.it the 
prob lem^ ,are , *'ho needs help in changing, and 
then look baci*. and see what research Is 
necessary.*'" Some of tne Centers in the 
Division of Special Mental Health Programs 
al^o have been set up around high priority 
areas, with con>bi nat ions of research, train- 
ing, and sometiiDes services all focused on 
ti^e priority concern. /- 



a network of contacts with practitioners »n 
their localities. In varying degrees, de- 
pending on the user-orientation of Lab or 
Cent er^anagenen t , these practitioners are 
invited to participate ir the planning and 
development of products -and the conduct of 
research even though there is no particular 
official sanction or reward f rom Wash i ng ton ; 
for doing so. 



The middle I960's saw an--evolut ion In 
the USOE's understanding of the r.»ed for 
integrated RDDtU. However, this evolution ^ 
of unde rs tand I ng has occurred in ^ha t order 
f.e.f .from an initVal concern for Beeeay*'^h 
in quantity and quality to an awareness of 
the need for Dm^^.tapnc'-nt as a separate acti- 
vity building on research, to /Hnn^rriiVjit U'm 
as an activity of national disirlbption of 
the output of RfcD. Now. gradually there 
seems to be Increasing recognition that 
even dissemination Is inadequate and that 
users need help in adapting, instaliUng. 
and Integrating R&D products in their every- 
day work. 

With this increasing awareness, the 
ro^e of NCEC h^^s become more salient in 
the thinking of OE planners and policy makers 
Thus , for example, they have become Increas- 
ingly involved In assisting Regional Labora- 
tories in the diffusion phase of large scale 
development programs such as the Far We^l 
Lab's Ml n I -Courses . 



-193- 



M.A. IXifidicfn of Utilizatl 



The concept of "spin-off" from one 
project to larger programs 6i other R/;D Is 
recognized throughout the R&O program. An 
example which follows this function is the 
Inmate Trai-ning Program. This program 
originated In a series of E&D projects in 
the area of correct rons and inmate training. " 
The findings were passed through a "policy 
devcloprnent process" : many practi t loners 
were I nvo I ved m the devel opincnt of the 
^program (staff i nf Co r rec t ions , employment * 
^'servlcestaff, e5c.), Teglslationwas pro- 
posed and secured, and a training program 
was launched as a result of "conscious decisions 
based on policy papers that had been developed." 



'19^- 




SRS Rdi.u-.ii\*h Vt i '. iz.it Bj\inch 



Other projects such as the RU Laboratory 
in the Chicago Jewish Vocational Servfce (JV$) , 
also center their efforts around an inte- 
grated program wi th a specific tor>ic focus. 
The JVS has conducted a whole range of acti- 
vities, from surveying needs to replicating 
projects over time.- 
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However, the most salient example of 
the integrated ffOt/tU programs appears to be 
in the M5HV efforts that are directed towards 
the cnPdrenS area priority. Efforts have 
includec t^^e dcve loi..^ent of a "cadre" of 
in-noust experts In this area, with the cadre 
broken cown into 3 operbling sub-committees: 

1) one i:ub-conviii ttee is developing a I Tst of 
needs ard program emphases for this area; 

2) one ^ ub-commi t lee is developing models with 
which to coordinate consultation to the field 
and alsc is outlining resources within KIHH 
and other agencies which are availab.4-e to the 
regions and others; 3) one sub-committee is 
actually working on the development of 
childrer's programs. Also in the children's 
mental hea I th ■ area , son^ local training 
instltut»*'j have been set up„in centers with 
model prog<ams, with these workshops being 
"how-to-do- i t" oriented. These efforts are 
not based on single programs or pieces of 
research, but rather are based on a combin- 
ation of research, denxjns t rat i on ^ and even 
service programs. One staff member of the 
Branch noted that this effort in the children's 
area has been the most well planned and 
"catholic" effort designed by the Branch. 



In spite of i ncreas Ing ■ i nvol verneni , how- 
ever; NCEC is still not involved in the 
tiatii'K of concentrated R&D program thrusts; 
however, the word "Integrated*' may tre mis- 
leading. Generally, NCE.C begins involve- . 
ment In the RDDtU sequence after It has 
reached some form of "product" status and^ 
long after the basic research and need 
definitional activity'has taken place. 
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6 .10 Wdcrosysrem Model I ing 

The iTviximal DSUaSystem 
should ^kave a coherent and 
cof^sensual image ot toe 
evolving maC'OSYiten >o 
ihgt gaps and points^f need 
can be identified and mon i - 
lored . 



tiiP •niliBatxon 



6. 20 Hacrosystefn Monitoring 

The fnaximal D6U system 
should be to a position to 
men J t'f5T~^or the macrosys tem , 
i.e. to^Li^f^e^ the streams 
of "social indicator" data 
whicli assess the current 
health of the system and 
the cnanging needs and 
prob I ems of users . 



Images of the systemic framework within 
which ORO and the Division are placed are 
se 1 dom made exp M c i t . Organ i zat I onal cha rts 
are not in evidence, and the notion of a 
sys tern of de I i ve ry of manpowe r se rv i ceS . 
either nationally or locally, is not always 
detailed. Hence, it is difficult to pin- 
point weaknesses in the chain of communication, 
service delivery, or need expression. Some 
Jifficul.ty arises from the relatively young 
discipline of "manpower" itself, which has 
grown primarily inr the 1960's: "everybody 
is a self made expert from various back- 
g rounds . " 

.Nonetheless, it is clear that thought 
is given to this and that there is some con- 
cern over modelling. In a memo dated 1969» 
the Division Chief stated: '.'...the utilization 
f unc t i*on . . .mus I be seen as a system, and must 
be organized so that It functions as a system... 
The" full qoal Is a manpower system. . .which Is 
contvinuaUy absorbing and us t ng new ^ deas , 
new techniques, new forms of organization, 
new ways of delivering services." The Divi- 
sion Chief has also promoted contacts among 
the D&U staffs of various agencies to "see 
where utilization fits Into the total system." 



This is not the resporVi lb i I i ly of the 
Division Rather, staff in DRD, OPE » and 
higher levels of the organization have res- 
pons i b i ) i t i es tu keep attuned to such data 
and relay this data to key policy makers. 
Use is made of program evaluation reports 
and "external facts," e.g., demographic 
proj ect ions , unemp loyment r«tes , etc . , to 
monitor. the health of the manpower system. 
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Although RUB has had no formal juris- 
diction to utilize findings from all the 
research programs In SRS, it has been 
working toward the development of an SRS- 
wide utilization system. RUB has proposed 
a study to design such a system and has 
been working via task forces and In-house 
written materials to promote this idea.'^ 

However, one of the problems In the 
agency has been the lack of a conrvDo per- 
ception of the system. The various bureaus 
and research programs have been based on 
different legislative authorizations and 
the forme r I y^. separa te programs have tradi- 
tionally had their own constituencies, their 
own funds, and their own modes of operating. 
Various offices other than RU8 have been 
working to develop a coherent image of 
the agency. The new management process, 
involving both bureaus and research staff 
In defining and carrying out agency objectives 
may be a means to define the systef^. The 
action of the Office of the Secretary .;n 
withholding funds for a tfme from pcrtic^s 
of the research program may have also teen 
intended to force awareness of the co'^non 
operating grounds among research programs 
and bureaus. 



No activities focused directly on this. 



*Grant awarded to the Center for Research on 
Ut i I i z^t ion -of Scientific Knowledge, Insti- 
tute for Social Research, Un i vers I ty of 
MIchlgartSn June, 1972. 
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There appears r.o be no central focus 
in N I HH for tni^ mdc f cs y ^ t err building, and 
t^iis task would appear ro be difficull. 
There are many "s uD - ■> / s t ens ' ' in Ji^lMH »vh 5 ch 
are orgdnized Independent!, jruund specific 
research or problem areas - >r example, 
the Centers in the Divisic f Special Mental 
Health Programs are focuse. jn pnority areas 
(e.g., crugs, crime, etc.), jnd ihev promote 
some system buildfng around tr^ese problem areas. 
However, these sub-systems do not appear to 
be integrated, and this would appear to work 
against the development of an agency-wide 
DSU ^stem. ' There has been some movement 
toward fracrosystem building jn certain areas: 
the development of an NlhH-wide evaluation 
system, the promotion of ioint funding across 
the agency and outside, efforts to coordinate 
behavioral science activities that cut across 
Branch and D't^vision boundaries and disciplines. 
However, these activities are not in the 
area of 06U and there is a tendency for the 
'units to do whatever thev can. One respondent 
stated that his unit didn't have the mechanism 
to do the job of D&U , but "if we don't assure 
that this wi ! I'-be done , who else is going to?" 
Thus, there is no way of assessing the gaps 
in preser>t DtU activities or where the great- 
est need^ in the system may be.*: 



As MHSV lacks adequate knowledge about 
what is c|oing on in the rest of the system, 
the Branch Is not in a position to be able 
to monitor for the macrosystem. However, 
as in the larger MH5 Division, center site 
visits are utilized to identify problem areas. 
It was felt that these proble^^is should be 
fed into the , know I edge base because the 
information may be helpful not only jn work- 
ing with other centers, but also in modifying 
the definition of their program. 

There Is an NiMH in-house rrtudy being 
conducted to as'jcss the research programs of 
the institute, i.e., wh«^r jhey have done, 
where they should he going. 



USOE strives mightily for a coherent 
image of itself within an educational macr.- 
system through the exhaustive policy and 
program planning process which each unit 
must participate in. In spite of these 
efforts, there is sorne doubt that such an 
image emerges and more doubt that it is 
consensual. Respondents (outside NCEC) 
cited various inhibiting factors: e-g-, 
diverse sources of legislation for programs 
in OE leads to many duplicating efforts; 
one informant claimed that there is a "non- 
strategy in OE for bringing about Improvement 
in education"; although most of OE and the 
United States think in terms of the teacher 
as an Individual entrepreneur, researchers 
talk about buildfng instructional systems. 
One observer noted that information about 
what other Bureaus are doing is commun i cated 
on an i nformal bas i s ; '*Wh^t we don ' I have 
Is a program (n which we couTd spend money 
to reach users; if we would try it, we'd be 
told that it belongs in NCEC." The fact 
that there are so many progr«ns in OE and 
that in the past it has been difficult for 
the Conmi ss i one r " s Office to keep control of 
anything was cited as another Inhibiting 
factor. NCEC staff felt thai an identifica- 
tion of the elements in government relating 
to OSU Is very important. 



As mted earlier under Section A. 22b 
and el sewhe re » NCE C is cu r rent ly sponsor i ng 
two pilot projects related to monitoring at 
Mi ch i gan and St an ford . These p rojects may 
additionally lead to some sort of special 
macrosystem monitoring process, but none 
exists at the present time. 



11 



*A Studv >oop on ^ir'lIzal•on af^d linkage con- 
ccrr<- **'*.-'-< '<\¥t^ MAS organ jed %fter our in- 
t e rv i esw T sta'jc. tnis Task r^^rce also hold'. 
* mciC^ prc*T.ise in terms of macrosystem monitor- 
ing at the Institute level. 
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6. 30 Promoter of L i nkage 

The maximal D&O system 
could see itself a% a pro- 
moter of linkage genera'l> 
within the macrosysten and 
also between macrosystems 
in different need areas. 



The development of Informal linkages with- 
in the Md npower Adm i n i s t rat i on has been a 
guiding principle of the Staff within the 
Division. The use of the "buddy system," 
the development of informal contacts with 
users, and the staff members' roles as 
catalysts in linking others alt confirm the 
Importance of this principle. Nor have 
Division staff members limited their role as 
linkers to those within the M.A. Some staff 
have invested a great deal of time in develop- 
ing linkages with 'jtaff In other agencies, 
e.g.. vocat i ona 1 educators and vocat i ona I 
rehab i I 1 tators within the Department of Health, 
Education, and Welfare. The Division Chief 
has attempted to maintain ties with OfcU 
staff in other agencies and was one of the 
founders of the Inter-Agency Seminar Group 
formed to consider uliM xat i on i s sues , Other- 
staff within ORO have also noted the importance 
of linkages. As one respondent stated, utili- 
zation requires "a whole series of Inter- 
faces'.' among federal offices, regional offices, 
state offices, and other federal agencies. 
One important means cited by an ORO staff 
membe r i n deve lop i ng 1 i nkages between the 
macrosystems was through joint funding of 
proj ec ts , 



In its work, RUB has stresseci the 
importance of building networks and ha^ 
served as a catalyst in many of these efforts: 
it sponsored the RU Specialists to establish 
linkages at the state level, it has linked 
some of the RSA staff, one of the RU Labs, 
and the RU Spec i a 1 i s t s toge ther in their 
joint work on t^e PAVR program; it has link- 
ed researcher-consultants to the state 
p rac t i t i one rs th rough f und 1 ng . AM ih k s 
activity was encouraged under the assumption 
that RUe, given its small staff, cannot 
and would not accomplish this task alone 
or di rectly. 



b.^0 F> n ing Recognized 

This function for the 
nrtdxlmal OtU system involves 
filling recognized gaps with 
new roles or organizational 
forms for DSU activities. 
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Stc.ff members . n ir f v ' e^^od f^oCeJ th.it 
the crij'nels among in« various resedfch 
progr^ami in NIMH jre /^ot M de»velopec). 
Wobt :>f the MoKatje jctivities are conducted 
informjMy or oi an Individual un » t basis, 
e.g., tre linkages of most unit staff<:> to 
prof ess r ona ) s jnd researchers m the'il\ 
particular areas. There were .ome respon- 
dents wr o noted the "insularity" of professions 
even withm N IMH , i ih -jtaff experts in a 
particular area having closer channeJs to 
other researchers in their special field than 
•vith staff in other portions of the Institute. 
"Somel if^es you find uut what others are 
doing in NIMH by reading It in the morning 
paper " There were effort-, cited to tie in 
[he various research units ond areas For 
eKample, a "social change" seminar has been 
^ei bi staff in the Director's Office to 
yovide a channel for exchange oetween i n- 
^ouse staff from various units as well as 
with researcners brought in for the seminar. 

Thert' also have been efforts to develop 
"cross breeding" among federal agencies, 
for exarjie, inter-agency groups have been 
set up IT the area of crime and delinquency 
and these groups are designed to open channeJs 
anoonq the agencies as well as to promote 
and plan for joint funding of projects. In 
the NIMH Director's Office, there are some 
staff members who have links to other agencies 
tnat would not be appropriate for any particu- 
lar Division, Yet the assurance for these 
linkages appears to be only through the 
research programs and units supported by 
NIMH, i.e.. If there is a research program in 
psycho-pharmacology, there will be linkages 
to that ^ield of research. Through this ad 
hoc type of linkage system, however, there 
may be certain audiences which will not be 
hooked' up to the system through oversight. 

Interpersonal contacts w^th practitioners 
probably carry such a linkage promotion com- 
ponent. On a different level, participation 
la the c<*ntinuing inter-agency D£U seminar 
group serves to ge'ierate awareness of a cross- 
agency concern with D&ll. 



One the oh i e c t i ve s of NCEC is linking 
ai vdfio.iS gc>ve ' hrrieru levels to build a 
0£U nvt^ofk "Wh.»j we're about Js trying to 
develop a network' by finding Out what the 
relationships .ire between the three levels 
of governrnem (federjl, state, local) and 
how J DfiU sysie^Ti ^ jn be operated. The role 
of the federal qovr rnrru^nt in such a system 
was seen to p^-in'ide seovj ">oney and a certain 
amount of p rv:)q --an expe r t i se via s pec ■ f i cat i ons , 
men i tor i ig as ^ i st ance , etc., and also to bul ) 
a knowledge base. A major development for 
NCEC has been the work done on the Pilot States 
01 ssem i nat i on p rog ram with the installation 
of field agents iind information specialists 
• t the state and local level . The concept of 
the extension agent has been expande: :o in- 
clude resource linking activ tv anc fcMo-w-up 
activity to help clients along towara ere 
adoption of innovations. The assumptions 
behind setting up these model pilots is 
that information of a certain quality and 
recency is needed by practitioners to make 
^ecisions, that prfnted Information is not 
Sufficient and that interpersonal contact 
is needed. 

In addition to the pilot states, NCEC 
has funded state and local information 
O'inters and the National Secretariat Project, 
in which meetings are convened with the 50 
dissemination-liaison people in an effort to 
establish this network of linkage. The 
Extension Support Branch is involved in a 
longe r -t erm de ve 1 opment , e.g., extension 
system, networking idea of strengthening 
state agencies so they become more active 
in the dissemination field, etc. One of 
the objectives of i h<: extension agent system 
is the establishment of liaison and working 
relationships with all of the clients in the 
assigned target population. 



An in-house project conce rns the set t i nq 
up of a progr.jm tfi collect information about 
promt s ing educat ional practices on a n.gtfonal 
bas 1 s ; this has been done In co I 1 aborar i on 
with state agencies. By next year, NCEC 
plans to provide phased Support for the 
development of information service cenfe/s 
in eviMy slate .iiien<:y , ranging from design 
srudles ill stiites with K»w levels oi rfcU'. >os> 
|r, !;j)e r ».i i ona 1 support In stales with re'.i- 
tively mature capdlj i 1 i 1 1 es . Such units woufd 
have the capacity for using the ERIC system 
and might also have linkages to the Regional 
Laboratories* One of the factors affecting 
the shift to greater use of ERIC products by 
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6 . 50 System Awareness Build- 
i ng 

The maximal D&U system 
could serve the function of 
generating awareness of 
system members of themselves 
as part of a system. 



The Division has not concentrated its 
efforts in this area due to philosophical 
reasons and lack of resources. The staff 
members have stressed i nforma 1 contacts , and 
some members questioned the utility of 
developing formal 1 inking roles ; "Do you 
build a formal network or an Informal network 
of people who really care?" "Are linkers 
made or born?" However, some in-house efforts 
have been made to fill gaps and prevent 
slippage in the system: the Division has 
been developing checklists for documentation 
and guidelines to define who does what in the 
system; staff members in the Division have 
been assigned to develop some means for 
communication with the regional offices; 
staff in ASPER have instituted the Advanced 
Research Briefs to fill gaps In links to 
pol Icy makers , 



Historically, there have been some 
difficulties in building system awareness 
within the Manpower Admi n i s t rat i on , The 
*'blrth" of the Manpower Administration has 
been relatively recent (the early I960's), and 
•nitially parts of the system, e.g., USES, 
were regarded as "separate entitles." "Bureau- 
cratic jealousies" and differences in out- 
look among staff have also been cited as 
barriers. However, some respondents noted 
that through various Jttempts, the Manpower 
Administration has become more "closely 
woven together." Committees were established 
to Involve both research staff and operating 
staff in the RtD program and Informal, 
interpersonal contacts have been developed 
to weld relationships. The Division has 
encouraged awareness of the utllliatlon 
system through the "buddy system" and other 
personal contacts . 



Within the limits of its funding base, 
RUB has worked to fill several perceived 
gaps in the knowledge flow system. To 
reach practitioners RUB felt it was neces- 
sary to move out of the centralized R.D.6D 
model which characterizes the traditional 
dissemination acts of the federal Dl:reaucracy 
and move toward a centralized linkage model. 
To reach the local and state levels more'" 
effectively, the 9 RU Specialists were 
funded and established in 3 state agencies. 
It Is not certain, however, on what basis 
this gap was identified, and whether RU6 
has any standard sensing procedures for 
Identifying gaps beyond that management 
process recently initiated at the federal 
I eve I . 



RUB has not had the responsibility for 
generating broad awareness among SRS-relevant 
practitioners, researchers, clients, or 
civil servants that they are part of a sys~ 
tem. Although no unit has been as:igned 
excQuslve responsibility for this function, 
it appear<i that the new management procedures 
may be directed at system building. Th« 
action of the Office of the Secretary may 
have also been attempting to generate system 
awareness. However, from Interviews it 
was apparent that there were still spmc 
problems in generating this awareness. Some 
mentioned that they were still trying to 
make the reorganization of I967 "gel." 
Others commented on the disparity of the 
various programs: "the bureaus are almost 
separate departments In many senses." 
These problems only highlight the necessity 
for fulfilling this function of generating 



ERIC 



-200- 



N:\f: Mentj. Health Stir-'uet* i>ei't^ i^ipnent Branoh 



states and locals wds said to be the state 
•nd 1 oca I in forma t i on cente rs a 1 ready ei t ab- 
llshed In a number of places v^ith support 
from Title 111 funds from the Education Act 
of 1965- One of tne functions of EPC ib 
to serve as an adffil n ! s t rat i ve center and to 
aid in setting up various information centers 
across the count ry. 



Outside NCEC, the Research Coordinatinq 
Units (RCU's) of the Bureau of Adult Voca- 
tional -Techn leal Education p robab ly rep resent 
the clearest example of a policy of linking 
and gap'*fniing. KCU's are supposed to "get 
the results of research into the hands of 
people In the local districts," operating as 
a national network which includes their own 
ERIC Clearinghouse, and linkage to the ERIC 
Sys tern. 



There has been no NlMH-wide effort In 
this area. N t KH has attempted to fill recog- 
nized gajs on a project basis in a few cases, 
e.g.* funding for demonstration project 
officers or action consultants to provide a 
Unk where none may usually exist, but this 
effort has not been picked up systematically. 
There is no formal extension system supported 
by NIHH, no network of linking rotes, and 
no O&U laboratories. 



The res pons i b f I i ty for system aware- 
ness bui ding does not lie within any of 
the Divisions; rather, the occasional efforts 
that have occurred appear to be initiated 
by so*^ of the Offices, which have responsi- 
bilities for overall NIMH administration. 
For example, the aforementioned seminar on 
social change to bring NtMH staff together 
from different Divisions and to Increase 
"intellectual discussion" among various staffs 
of NIMH has been conducted by a staff member 
in the NIMH Director's Office. However, 
giv«n the diversity of research sponsored by 
NIHH, rarging from very basic to very applied, 
it would appear that more efforts in this area 
are needed to promote the idea of a macro- 
system which encompasses the different sub- 
Systems of research. 



NCEC has no assigned responsibility to 
make educators, researchers, and government 
officials more aware of each other as parts 
of a system although It may eventually turn 
Out that a successful national extension 
service may do just that. 

Within OE , s me informants felt that 
they were already seeing changes toward 
greate r awarenes s of i n i(* rdepcndenc i es , this 
trend being exemplified by more staff meet- 
ings within NCEC and, at a higher level, 
more open access to the commissioners. An 
In-house newsletter titled De ve 1 opment is 
now circulated regularly to OE staff. Each 
of these developments, while relatively 
trivial in and of themselves, should add up 
to an atmosphere of rrvitual awareness and 
togetherness which Is probably essential 
for a healthy organization. 
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Maxima i- DiU Syatm 



M.A. Divieijn of H4D Utilization 



bys tern awarenosb . Among researchers, 
practitioners, and clients the system- 
awareness problem is even more acute. The 
truth is that the term "SRS" as a collec- 
tlva enterprise means almost nothing even 
to those people most closely involved in 
and affectad by its activities. 



-202- 



ERIC 



CofTTuni 'at i 'n 



It was clear, howe ve r , that ot he r 
informants had an opposite impression o^ 
current t rends . One respondent said: 
"There's a business orientation, i.e., every- 
one for himself. This selfish operation is 
not good for government," The problem with 
OE was seen as one of a non-strategy for 
bringing about improvement of education: 
'•yOu'vc got 70 sone pieces of legislation 
in OE, 200 some progr.i'^s ^ith most of this 
money formula money, tsut what you don't have 
Is several billiofi dollars for pushing the 
products of OE and training people to use 
these products." Another non-NCEC observer 
felt that there was a change for the worse 
in OE's managernent problems due to the present 
adml n I s t rat i ve po I i c i es , and that the atmos - 
phere is much more "closed and paranoid" 
than It used to be; this atl'tude was felt 
to be government-wide. . Because researchers 
talk about building systems and most of OE 
and the U.S. think in terms of individual 
ent repreneurs , one respondent suggested that 
a change in the philosophy of the U.S. and 
OE , i.e., to thinking of systems, was necessary 
In order for research to be used. 



{ 
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CHAPTER V 
PILOT SURVEYS OF LINKAGE 



I . INTRODUCTION 

In the work reported so far we^have produced descriptions of the 
structure and proce-ss of D&U units and activities seen from within , from 
the perspective of the agency staff member. Obviously, however , D&U by 
its very nature involves many important groups outside of the agency. 
Only through careful assessment of the non-agency suppliers and consumers 
of knowledge can any D&U program be fully described and evaluated. Our 
primary point in the model presented earlier is that O&U must be set , from 
a systemic viewpoint, one which accounts for both the linkages between 
groups, and constraints, capacities, and needs with)in these same groups. 

Thus, because of the limited ability of any group to describe accurately 
the entirety of their loosely-connected system, and because we need exactly 
such descriptions to derive an accurate picture of DSU, we moved outside of 
the agencies to conduct pilot studies of system-wide linkage, using two of 
the four agencies. Part of our intent was to produce data which would 
converge upon those reported above, while at the same time expanding our 
knowledge beyond the agency setting. In addition, we were interested in 
developing a methodology which, if and when validated, could be utilized by 
agencies (or its perspectives incorporated into other data gathering efforts) 
so that the D&U system might achieve a greater capacity for macro-system 
monitoring-. Such a methodology could also be used to gather base-line data 
against which change efforts might be evaluated. 

An effective monitoring device must meet three criteria. It must: 

(1) provide valid and reliable data on actual linkages within and 
across groups, considering needs^ channels, content, and uses 
of information sent and received; 

(2) provide data on attitudes in all parts of the system regarding • 
the D&U process in general, and speci fi c. products and processes 
in part i cul ar; 

(3) be cost-effective, giving the maximum amount of data for the 

least cost in dollars, administrative and analysis time, reslpondent 
effort, and translation effort required to convert findings into 
implementable actions, ''f 



* We should note that this is an ultimate objective which may be reached 
only through successive approximations, partly because we can only learn 
what data are required, and how to gather them, by actually going through 
the whole process. As an example, the now standardized surveys of organ- 
izational behavior, intelligence tests, etc, all went through many 
years of theoretical and empirical refinement. D&U research is just 
beginning this process. 
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The primary concern of understanding linkage is parallel to, but not 
identical with the D&U model presented in Chapter III. Our concern here 
is more ''micro": we are interested in mapping specific communication 
behavi-ors following the familiar paradigm of "Who says What to Whom through 
which Channels with what Effect." This more basic approach will provi^ 
data which may then, in analysis, be aggregrated to assess the communication 
of any content (e.g., need expression, solutions deli/ered, policy-relevant 
informat ior)) , within or across any groups (e.g., from practitioner to 
researcher or vice versa). The model used here is descriptive rather than 
presc ' * ve; we are searching for data which may be related to, or serve 
as tests of, the comments typical to Chapter IV such as "maximal activity" 
or "insufficient contact." When micro-level analyses of existing linkage 
are available, they serve as a tool within the broader D&U model to help us 
determine areas for change in the form of increased activity, more transfer, 
etc. Such data then may be collected again to get sc5me idea of the effects 
of changes. 

Our second criterion was for data on attitudes regarding the D&U process, 
and on information needs. In part we are interested in the evaluation 

the person gives to his communicating or linking behavior, or that of others: 
is there enough or too much of some content coming from or going to another 
person or group? Are the media the right ones? What is the level of satisfact 
with effects? Seen this way, our more familiar concept of "Information needs" 
becomes only one pole of the evaluation of content (since we assume usual ly-- 
and often uncri t i cal ly-that most needs will be for more, rather than less, 
i nformat ion) . 

I 

A second aspect of the evaluative dimension, that of D&U in general, 
develops from our desire tq build and test theory of the process. Here we 
a^re asking for evaluations of concepts our models claim are important or are 
related. Such evaluations may also be used to provide insight on those aspects 
of D&U deemed important in different parts of the system. 

The third criterion applies to the "best" way to' meet the first two 
criteria. Decisions, however, must be made only after consideration of specifi 
methodologies for assessing concepts at different possible levels, or from 
different "units of analysis." This point needs expansion for clarity. 

There are several alternative approaches which might be used to assess 
linkage in a D&U system, varying both on the methodology used and on the unit 
of analysis studied. Ul timately ,^ many or all possible conu i nat i ons should 
be tested (as was done for the field of educational needs assessment by Mick, 
et-al., 1972). The task grows as a function of the number of combinations 
of alternatives for methods'and units of analysis (assuming we are studying 
the same concepts at the same times). For example: 
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Methods : 







w *1 

Surveys , e.g. ,^ 
ques tlonnai re 
or i nte rview 


P rocess 
mon i tor i ng 


Unob t rus i ve 
measures or 
secondary 
ana lys i 5 


Uni ts 


1 nd i V i dua 1 s 








of 

Ana lys i s : 


Groups 










Commun i cat i ve acts 









This table is an example, by no means exhaustive of the possible approaches, 
and yet it gives nine potential studies to be conducted and compared (though 
some may be, a priori ^ meaningless or impossible). 

Fortunately, criterion three (cof effectiveness and effort) comes to 
our rescue here. We are looking not for the test of aH poss ible methods , 
but for the practi cable ones which will provide the best assessment of the 
several linkage and attltudina'l indicators required. 

(n making decisions regarding the present project, our calculus of 
methods and units resulted in the adoption of mail questionnaires to collect 
data from individuals representing most of the major groups in the D&U system. 
We could aggregate data from Individuals to groups in our analysis, and ask 
questions of individuals about typical or important communicative acts; thus, 
we could approach (though not dupilicate) other levels of analysis. This 
choice is a typical resolution to such problems, since using groups as the 
only unit of analysis would ignore important individual differences in infor- 
n\ation processing and necessitate direct observation. Strict use of acts 
of commun i cat io.-^ as units involves development of markers or tracers on 
acts, and could not give us attitudinal information except by special measure- 
ment of the individuals at each "end" ..of the act. 

Our desire to produce an i nexpens i ve method , once we had decided on 
individual units, was the primary reason for settling on se 1 f -admi n I s te red 
(mailed) questionnaire methodology. We balanced the knowledge, that such 
surveys have given adequate response rates in the past from wel 1-educated 
and committed respondents with the realization that time pressures on busy 
people might Interfere. In addition, the method, "if it could demonstrate 
fts utilityj would be one which could be repeated easfly by DsU workers in 
the future , " 



I I. METHQDQ LOGY 

The studies described here were performed for only two of the four 
agencies. Manpower Administration and Social and Rehabilitation Service, 



O -207- 



ERIC 



This reduction from our original design was necessary once we discoverecl 
the amount of time and effort required to complete the four case<studies 
and to develop the model. Our choice of agencies resulted in part from 
the order in which the case studies were done (MA, then SRS, NIMH, and OE) , 
which allowed the pilot studies for the selected agencies t^ be implemenvted 
earlier. The exclusion of OE is perhaps fortunate in the sense that th^■^. 
agency was undergoing the transition to its present divided structure, so 
that ] i nkages. were not stable. NIMH and (now) NIE may benefit from their 
exclusion, since we will propose below to apply a revised and refined version 
of the approach for these agencjes . (At this writing a proposal to this 
effect has been submitted t,o NIMH), All four agencies agreed to our request 
to limit this analysis to the .two selected. 



A. THE INSTRUMENT - ^ 

We have already presented the basics of - the linkage model used here, 
and the outlines of attitudinal* I'nformation -desired.^ These areas are covered 
in the questionnaire (see Appendix A ), together with two more specific Tines 
of questioning covering how information f 1 ows- dur i ng "cr i s i s*' situations, and 
unmet information needs. Job and demographic data were also collected. 

1 . Information Sent ahd Received ^ . " 

^ " > 

m Linkage i tems^ in this study were finally assessed by asking for the 

two persons, groups, or organizations to whom the respondent sent important 
information, and the two from, whom important information was received . The 
exact form of the questions was selected after a pre-test which showed us 
that it was un rea 1 i St i c to expect respondents to evaluate their contac^ts with 
all of the groups we specified.* The alterirtative of asking respondents t,o 
mention specific important c?5mmun i cat Ions in some time frame^ which was adopted 
here no doubt underestimates rare but important communication which may not 
come easily to mind.\ The implication of our approach g s ,that the "linkage 
maps" we will produce do not represent aipounts of communication between and 
within groups, but rathef show the evaluation of important linkage. Adequate 
mapping of absolute levels, as well 'as evaluations, must aWait fu'.ture research. 
In summary, the approach we used separates Important information from the total 
Information sent and received, but it does not 'te. Ij us how otuch of the latter 
the re i s . ' - ' • 



* A pre-test of a longer, more detailed Instrument, was conducted In June, 
1972, at a New York meeting of SRS Research Utilization Specialists. In 
effect, respondents were faced with the chore cf completing a matrix^of 
content, media, frequency, and uses of Vommunicati on with all other groups.. 
This proved much too demanding. Marginal comments on this and other points 
were used to refine the ultimate instrument. Several 'pre-test r^espondents* 
were also included in the SRS name list. We ut I 1 i zed the pre-test res^ponses 
for these individuals, recoding them to fit the revised questionnaire. 
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For each- of the two groups which respondents rnentioned as providing 
important information,, we gathered data on type (content), frequency, media, 
and uses of information. Similar questions were asked about important.. " 
i nji^ormat ion sen t , except that "uses" referred to how the respondent thought . 
his audience utilized the information sent to them. Since we had asked for ■ 
important information, we did not add an evaluative component.- 

2. Unme t i n forma t i on Needs 

•. ' * ' ' r • 

A section on unmet informa'fi on needs* does 'approach an evaluative 
component. In this section 'we also asked, in addition to content, preferred 
media, sources, and uses for which information was needed. 

3 . information in Crisis Situations 

■ Y 

Questions on crjsis situations were added .as a result of several 
discussions with agency" staff during the case study interviewing and feedback. 
Many staff members expressed t„he view that government often operates by "crisis 
management"; du.ring crisis periocjs information flow and use may be different 
from less hectic periods. Again,^ content, sources, media, and uses were 
assessed. In addition we asked the respondent to define a recent crisis. 
We«-also asked for ratings of needs for i n format I on - from wi th i n an'd from outside 
the work organization, success rates, problems encountered in getting infor- 
mation, and suggestions toi insure better i^nformation flow in similar cerises. 

k, improving Utilization and Attitudes on Utilization Strategies 

Attitudinal data we.re gathered through*one broad question on the most 
effective ways to insure utilization, and by th§ rated importance given several 
different statements about, D&U; we also asked for ratings on the extent to 
which each statement was actually exemplified in the, respondent ' s area of" 
work.^ The rat ing statements were derived from earlier work, and typified the 
approaches contained in the contrasting models of D&U identified by Havelock 
jL (1969)| in his search of the existing literature on D&U. Both of the evalua- 
t ive^dimensions wiTl' be analyzed in Chapter Vll, where they will be related 
to other datk'>on per5pective€ about the D&U process itself as seen from within 
and from outside the actual D&U' unit. At the end of this chapter, however, we 
will discuss the application of the D&U model developed 'in this project to 
the production of evaluative items, for future research . 



B. SAMPLING 

The procedures by which respondents were selected for the MA and SRS 
stuflies were designed more to test the method and give a picture of the context 
of each D&U unit than to give a representative picttire of the whole agency 
and its knowledge source and user communities. Our' decision was to select 
individuals who had had substantial previous contact with the D&U units, rather 
than to- try to compile a population list for the total system (a time consuming 
task, and one which might prove impossible). This bia? should be kept in mind 



* If we had asked for evaluation of communication with a 1 1 groups, then we 
would need some evaluation of the importance or val ue of each linkage, 
but by restricting respondents to important, linkages this question is not 
needed. ' ' . 
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as we analyze the results below; but since we are primarily interested in 
this project in'the world of the^ DSU unit, as opposed to that of the whole 
agency, we feel the results will be more comparable to the case study findings. 
We. should note that the selection procedures miss those persons who are 
potential, but not actual, linkers to the DSU units, and so we cannot use 
the findings to tell us to what extent the DsU units relate to their total 
possible community of researchers and users. 

Staff in the MA and SRS D&U units were asked to provide names of their 
important contacts in each of several groups (see below). Quotas were given 
for each group^ based on our impressions of group size, and considering t^e 
sample size we desired (about 100 cases per agency). DsU staff members inter- 
viewed in the' case s tudies were not included here, so we should note that 
the group.^ incl uding "DSU project staff" refers to those contractors and 
grantees 'doi ng DsU projects, and not to the agency unit. itself. Hopefully, 
any future study would re-measure DSU staff, and keep them separate through- 
out the analysis. The groups, together wl th the number provided by the D&U 
units and the final response figures, are given below: 





Quota 


N actually 


provi ded 


N useful 


quest i on- 




(max. 


by D£U iKii t : 


na i res 


received: 4 


Group: 


N.) 


MA 


SRS 


MA 


SRS /■ 


Federal agency policy and 
planning 


5 


5 


5 


3 


2 


Federal agency research 
administration 


15 


15 


15 


9 • 




Federal agency program 
administration 


15 


19 


15^ 


11 


13. 


Regional office staff 


15 


15 


15 


1 1 


, 10 


State agency offices 


15 


15 


15 


8 


15 


Basic and applied researchers 


15 


J 5. 


15 . 


]k 


12 


Demonstration and D&U 
project staff 


15 • 


15 


15 


12 


12 


V6ca\ agency staff 


15 


15 




10 




Other . (a free category. used 












by D&U staff for important 




8 .. 








contacts rtot contained 












.above) 












0 

T= . 


no 


122 


95 


8i) 


73 M 


%,of T: 








. 63% 


11% % 



(Overal 1 , c-80% of the MA and 82% of .the SRS sample members repl ied to our 
mailings, but ]\% of MA and' 5% of SRS questionnaires were incomplete, returned 
blank, or otherwise rendered unusable. % ^ ' -. 
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C. ADMINISTRATION 

The procedures used in collecting the data may be presented best in 
tabular form. Examples of the letters and telegram used are given in 
Appendi X . 





Admi n i s t rat ion 


Time tab le 








Steps: 


Dates : 


MA 


SRS 


1) 


Introductory letter explaining 
project and requesting cooperation 


June 


23, 1972 


Aug. h 


2) 


First questionnaire mailing 


June 


29 


Aug. 9 


3) 


Follow-up letter and second 
questionnai re 


July 


2^ 


Sept. 6 


k) 


Reminder telegram 


Sept 


. 5 


Sept. 26 


5) 


Phone Calls V/ 


Oct. 


20 





{* Not done because of relatively high response rate.) 



CODING 



This was an exploratory study, and as such we did dot feel we had 
sufficient prior knowledge to ask anything but open-ended questions about 
content and uses of information, types of= crisis, needs, etc. Th.us , we 
were faced with a substantial task of developing code categories from the 
responses. Our desire was to produce generic codes for similar items when- 
ever possible, both for ease of coding and for comparability across items. 
We discovered that most responses were so broad and complex that several 
distinguishable types of information, for example, could be ext racted. f rom 
the prose answers. Thus, we were obliged to code multiple responses for 
each question, noting the presence or absence of each code within the 
answer. ''^^ Codes were developed using the MA data and through a sefie^s of 
trials and re-definitions of codes using three separate coders. 



J 



Multiple cq^ding of items requires special analysis treatment, since 
there is usually more than one resp.onse per case. The best solution 
to sbi^t^he unit of analysis from the individual to the response, 
giving an ^'N" for analysis that signifies how manys^codes were used, 
.rather 'than how many people responded. ^Th i s is similar to our Shift 
to commun i catJ ve acts through aggregat (on of first and second groups, 
sent anil received. - ^ *• ^ 
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One single coding structure was used for types of information sent, 
received, sought during crisis, and needed. Common codes were developed 
for uses to which received information would be put, uses the respondent 
perceived his audiences made of information sent to th^m, and purposes for 
which information was needed. Nature of crisis and problems encountered 
in getting cr i s i s- rel ated information were also jointly coded. Separate 
codes were built for each of the remaining open-ended items. 



III. ANALYSIS OF LINIC^GE 

A. THE INFORMATION NETWORK ( 

The difficulty in network analysis is that we must encompass and 
understand a large amount of data at the same time: groups or individuals 
linked by channels used at some frequency rate, communicating certain types 
of information, for specific uses. There will be as many linkages as there 
are pairs of groups > and we must include communication within as well as 
across groups. In our analysis we will rely on graphic presentations of 
these data. In addition, we are aided by the fact that we asked for impor- 
tant communication, ignoring the dimension of frequency of contact. We 
will also simplify by aggregating content across the four possible mentions 
representing linkage of any two groups; this approach is dictated by the 
small sample sizes with which we will be dealing.* We will also combine 
the groups sampled into just four: Federal policy and administrative, 
research and development, diffusion and utilization project staff (note that 
these are not members of the D5U unit, since these persons were not surveyed 
in this study), and a broad group of practitioners or users. With these 
ground rules in mind, we may turn our attention to Figures 5.1a and b'^and 
their accompanying tables.^^'^ 

* There are four possibilities: group A mentions sending to group B, group 
A mentions receiving from group B, group B mentions sending to group A, 
and group B mentions receiving from A. With larger samp les oppos i te types 
might be used to validate communication, or to assess effects of channel no 
o r f i de 1 i ty . 

**The i ns tf uCvtions in the linkage section asked for impoj;tant communication 
with gje'rsons or groups excluding the respondent's dWn. As we will see 
later, however, intra-group linkage is often the most frequent type. The 
c'qllapsing process accounts for most of this (e.g., a Federal program 
administrator talking with a research administrator or policy maker). Some 
respondents di^ mention their own group in disregard of the instructions. 



FtGURE 3. la COMMUNICATION AMONG FOUR GROUPS, MA DATA 

Pol i cy £; 1 eg i s . : 
Performajji:u^-$-4ieaul at i ons 



Federal Pol i cy 
and Administrat ive 




Pract i t ioner 



Performance ; Regul at i ons 
* Arrow heads and tails indicate graphically the percentages next to them. Percentages 
on arrow tails rrtean of mentions of information sent by group A as mentioned by 
senders in group A"< Arrow heads indicate of information received by group B 
as mentioned by group B". 

(See Table 5Ja for the same data in tabular form.)) 
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COMMUNICATION AMONG FOUR GROUPS, SRS DATA 



Fi ndi ngs = performance ; 
needs and ideas 




Fede ral Pol i cy 
& Admin istr. 




Practi tioner 




Performance; regulations = 
pel i cy 

(See Table S-lb for the same data in tabular form.) 



TABLE 5.1a MENTIONS OF COMMUNICATION AMONG FOUR GROUPS 

MA Data 



GROUP RECEIVING INFORMATION 





Federa 1 
Pol t cy & 
Admin i s tr. 


Research 
& 

Devel . 


■ Dissem. 
& 

Uti 1 iz. 


Pract It loners 


Total Sent 

as flenti.oned by 

Sender Groups"" 


Fede ra 1 

Pol 1 cy S 

Admi n i s t rat i ve 


62 


8 

yX 73 


8 yX 
28 


23 

36 


100% of y 

39 X 


Research s 
Peve lopment 


52 / 


19 y 


10 y/ 


19 

yX 10 


100% of / 

31 ,y 

/ 


Di sseminat ion 
& Ut 1 I izat ion 


y \ 


13 X 
3 


33 


^40 

^5 


100% of X 
15 y 


Pract i t loners 


20 


0 y/ 




69 


100% of/^ 












Tota 1 rcvd, , as 
mentioned by 
receiver group 


100% 
X of ^9 


100% 
X of 30 


100% 
of 21 


y^ 100% 

^^/^ of 52 





Key: 

^ Sent - / 
As men- / 
tioned / % Received - 
by Sender/ As mentioned 
/ by Receiver 
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TABLE 5. lb 



MENTIONS OF COMMUNICATION AMONG FOUR GROUPS 
SRS Data 



GROUP RECEIVING INFORMATION 





Fede ra 1 
Pol icy & 
Admi n i s t r . 


Research 
& 

Devel . 


Di ssem. 
5 

Uti 1 iz. 


Pract it ioners 


Total sent as 
mentioned by 
sender group 


Federal 

Pol i cy 5 

Admi n i St rat i ve 


50 


16 y^ 
y^ 




32 y^ 

y^ 56 


100% of y^ 
11 y^ 


Research 6 
De ve lopment 


kk y^ 
y^ 17 


31 y^ 

y^ 33 


19 y^ 

y^ 1^ 


6 y^ 
y^ \k 


100% of y^ 
16 y^ 


Di ssemi nat i on 
S Ut i 1 izat ion 


0 

y^ ^1 


y 

3 X 
y^ 20 


19 

/ 30 


71 y^ 

y^ 17 


1005: of X 

21 y 

y ,% 


Pract i t ioners 


20 


12 y^ 
y^ 7 


10 y^ 
y^ 20 


59 y^ 
X 33 


100% of / 
i»l / 


Total rcvd., 
as mentioned 
by receiver 
group 


y^ 100% 
y^ of 36 


y^ 100% 
y^ of 15 


y^ 100% 
y^ of 20 


y^ 100% 
y^ of hi 



< 
r: 

o 



C3 

o 
to 

O. 
ZD 
O 

(_3 



Key: 



^ Sent 
As men- 
t ioned 
by Sender 



% Received - 
As mentioned 
by Receiver 



• 
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The first figure contains the data from the MA study, and the second 
is based on the 5R5 data. We will describe each briefly, nK)re as a guide 
to understanding than for complete description, and then zero in on a 
comparison of the networks of the two agencies. 

In these figures each group was analyzed in terms of the percentage 
of the total' nDent'ions made by the group which are given tb each group, 
including its own. This was done for information sent, based on senders' 
data, and for information received, as mentioned by receivers. Thus, the 
unit of analysis is shifted to mentions of communication rather than persons, 
since each respondent could mention two sources and two audiences. As a 
graphic aid in the figures, percentages of information sent or received are 
interpreted by the size of arrow heads and tails linking two groups. Arrow 
heads arriving at a group represent the percentages of mention given by that 
receiving group to incoming communication. Arrow tails leaving a group are 
the percentages the sending group mentions for each of its audiences. 

The figures also indicate the most frequently mentioned content flowing 
from group to group. Because of the small number of cases, we were forced 
to aggregate the content group A respondents ment ion^ sending to group B, 
and content group B mentions receiving from group A. This simplifies presen- 
tation, but denies us the chance to compare similarities in perceptions of 
senders and receivers. 

For example, the MA data in Figure 5.1a show that the Federal Policy 
and Administrative group are more active in communicating among themselves 
than to or from other groups. Here, 62% of the mentions of information sent 
list other Federal Policy and Administrative (Federal P&A) receivers, and at 
the other end of the linkage, m% of the mentions of information received 
made by the Federal P&A respondents originated with others like themselves. The 
Practitioner group also shows the tendency to communicate more internally 
than externally. "Performance and regulatory information" is common to both 
groups, with "policy and legislative information" being most common for the 
Federal P&A group. 

The R&D group appears sensitive to the Federal P&A sector, mentioning this 
group most often as the source of important information and as receiver of 
information sent. Content classified as "findings" was most common in both 
directions linking the two groups. In fact, it is not surprising that the 
R&D group's most frequent content is always findings, though this is equal in 
mentions to needs and performance information when coming from Practitioners. 
None of the Practitioners mention the R&D group as targets for their important 
communications, however, so that content code is based entirely on the R&D 
group's mentions of information received from practitioners. 
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We have already discussed the preponderance of internal communication 
among practitioners (with performance and regulations content most frequent). 
The Federal P&A group is most often mentioned as an important outside source 
among these practitioners, and the content is predominantly regulatory infor- 
mation. As mentioned above, this group does not mention RSD as an audience, 
and it only infrequently mentions researchers as sources. 

Dissemination and Utilization project staff (DSU group) mention practitioners 
as the most frequent client for information sent, followed by others in the 
D&U group. There is a moderate degree of fDention of the Federal P&A group as 
sources, but less as clients for information produced by D&U. Finally, there 
is a surprisingly small degree of linkage between the R&D and DSU groups, 
regardless of where it is measured. The DSU project group indicated more 
diversity in content handled (either produced or received) than did the other groups. 

Comparable data for the SRS analysis are presented in Figure 5.1b. The 
arrows indicate a basic similarity to the MA network discussed above: there is 
more internal than external communication among the Federal P8A and Practitioner groups 
the R6D group links strongly to Federal P6A; and the DSU group mentions Practitioners 
as the most frequent client for information sent. There is a greater linkage 
here between the Federal P&A and Practitioner groups, and somewhat more between 
RSD and D6U, Again, there is a surprisingly high mention of findings as content, 
not just from the R6D group (which we would expect), but to this group from the 
Federal P&A and D6U groups, and between D6U and Federal PSA and Practitioners. Th^P 
D&U groups in both analyses appear to be doing their transmission or translation 
job regarding findings. 

Information about needs flows from Practitioners to R&D as a priority content 
in both systems, though we have noted that MA Practitioners do not mention 
RSD as important receivers. There is more of a flow of needs (relative to other 
types of content) in the MA network, as compared to SRS, to the Federal PSA group 
from Practitioners. 
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In summary, we are struck with the overall similarity of the networks, 
particularly in the extent to which the Federal PSA group and Practitioners serve 
as their own best sources and receivers, and in the close monitoring R&D personnel 
keep on the Federal PSA group. It may be that we are measuring a part of science 
in which relations to research sponsors are more important than relationships 
to scientific peers or consumers of knowledge. Also by way of summary, we note 
the similar patterns in both agencies linking the D&U and Practitioner groups: 
in both the DSU project staff most often mention Practitioners as clients, but 
Practitioners more often mention Federal P&A staff as important outside sources. 

Some nuies on the limitations of these analyses are in order. First, 
we have discussed the findings without regard to statistical tests of signif- 
icance'. The nature of the data (combined mentions, based on up to four linkages 
per per^n) , and the relatively small size of the data set might be cited as 
reasons for this omission,. Also, we have not yet developed the appropriate 
models for significance testing in this type of network analysis. We might 
project that information theory, rather than significance, may provide better 
leads in the future, since the nature of the measures is directly related ^to 
the topic of investigation i .e, , information flow. 

^ 

-218- 



/ 



Another limitation is »that we have no direct data on the relay of 
information through direct re-transmission, or translation. We do not know 
if the DSU groups are translating .information received from R&D for their 
important Practitioner audiences. It i s me thodo 1 og i ca 1 1 y poss i b 1 e to add 
such data in the future {e.g., by asking for the source of the information 
each .individual mentions he sends out), A final comment on the method used 
he^e is needed: we sense a great potential for such analyses, the surface 
of which is only skimmed In this study. Network descriptions such as these 
could provide information on comparative variance in sources or audiences 
across groups, channel fidelity and similarity of content sent with that 
received, channel utilization for various content, etc. Such analyses will 
demand both larger data sets, and elaboration of both the possible comparisons 
and means of testing differences. 



B. MEDIA PREFERENCES IN THE NETWORKS 

In a large-scale analysis of linkage we would want to examine-the media 
used to pass particular types of content within and across groups. We would 
be able to identify groups having closQ interpersonal concacts, those engaged 
in translations of content from one kind of media on input to another kind 
for output. By making the assumption that Interpersonal media are used more 
as groups become more integrated, we could examine patterns of network inte- 
gration for specific content areas. Many other analyses could be made as 
well, but the sample size imposes limits. For example, in the MA data the 
Federal P&A group made a total of ^9 rentions of linkage with all groups, with 
just under half going to 'others in the Federal P&A category. Thus, with only 
nine linkages from the group to D&U project staff, and only five to Practitioners, 
it is impossible to break down the mentions according to both- content and media. 

It is possible to get some tentative Idea of integration among the four 
groups by ignoring content, and collapsing the n ine di f ferent media originally 
rated into two types, "interpersonal" or "informal" and "impersonal" or "formal" 
medi,a. This distinction has proved frui^tful in studies of communication among 
scientists (e.g., Parker, Lingwood, and Paisley, 1968; Lingwood, 1969). Results- 
of these studies showed informal media predicted scientific productivity better 
than use of formal media. Also, informal media correlated higher with numbers 
of sociometric choices scientists received from peers as valuable contacts. 
The basis for the dichotomy is thus the idea that Interpersonal communication 
Is more efficient, implies a past history of linkage (perhaps originally through 
formal media), and should facilitate two-way flow or feedback, all of which 
reflect integration of the network — which may itself be defined partly through 
sociometric closeness and availability of communication paths, and partly 
through shared orientations, values, and concerns. 
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While collapsing across media eliminates the rich detail of utilization 
of specific medi<3 for certain functions, it does simplify the analysis. The 
analysis for each agency resolves to this simple question: what is the oercen- 
tage mention of interpersonal media linking each group to itself and tc ct^ersT 
This is actually a conservative test in these data, since there are tv.'ce 
as many media classified as formal as there are informal media (six tc 
three), and the straight percentage is not weighted by possible choices. 
As in the linkage analysis above, we have each group relationship assessed 
by both senders and receivers, separately for information sent and infor- 
mation received. The results are tabulated in Tables 5.2a and b. 

Many things are compressed into these tables. Let us examine first the 
marginal percentages for informal media across the*four groups. These figures 
indicate the overa 1 1- dependence of the group on interpersonal media for the 
important inputs and outputs mentioned by members. We see in the MA data 
that there is some variation across the groups, and between sending and receiving 
within some groups. The Federal PSA and Practitioner groups appear to be best 
integrated through use of interpersonal media for the information they send, 
and the Federal P&A and D&U groups for information they receive. In the SRS data, 
the' overall use of interpersonal media is lower for both input and output, 
suggesting a less integrated system perhaps resulting from newness, or dis- 
persed or disparate units. SRS Practitioners remain highest in interpersonal 
media use for information sent. The D&U project group is much lower than 
other SRS groups, and very much lower than the roughly comparable MA group. i 



By looking within the tables we gain specification of the group media 
patterns. In the MA data, i n t ra- g roup integration is lowest in the RSD group, 
and roughl y .comparable in the others; but the figures (in the main diagonal) 
do not show that the groups have greater reliance on interpersonal media for 
internal communication than for linkage to other groups, a condition we would 
expect to find in a "real" group, but would not encounter in an analytical 
group which has no real cohesion in operation. In the SRS data, the Practitioner 
group does show somewhat greater use of interpersonal media for internal vs. 
exte rnal commun i cat i on . 

Some discrepancies in media use appear in individual cells, comparing 
ratings of senders and receivers. For example, in the MA data. Federal P&A are 
higher in ra ting i n terpe rsona 1 medi a for commun i cat ion to P ract i t i one rs than 
are the Practitioners when they mention getting information from the Federal PSA 
group . Di f fe ren t i a 1 pe rcept i ons of i mport ance of contact mi gh t expl ai n some 
of the difference. RSD staff rate interpersonal media higher in sending infor- 
mation to Federal P&A, compared to the ratings Federal PSA give to receiving infor 
'.,mation from researchers. These, pa rt i cul ar discrepancies do not appear in. the 
SRS data. There, the greatest difference is in information sent from DSU to 
Practitioners, where the D&U group mention interpersonal media less often for 
information they send than do Practitioners for that which they receive. 
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5.2a 



MENTIONS OF MEDIA LINKING FOUR GROUPS, MA DATA 

ft 

(Mentions of Interpersonal Media as % of Total Mentions) 



GROUP RECEIVING INFORMATION • 





Fede ra 1 
Pol icy 
Admi n i St r . 


Research 
& 

Deve 1 . 


Di ssem. 
Uti 1 iz. 


Practi- 
t ioner 




Overal 1 Send- 
ing Percent 
1 nterpersonal 


Fe de ra 1 

Pol i cy & 

Admi n ! St ra t i ve 




78 

61 


56^^ 
78 


9^4 y^ 
/^8 


72 y^ 


Research & 
Deve 1 oonient 


97 


29 


88'vX 
y^ ^* 


50 y^ 

y^ lOO'V 




Dissemi nat ion 
& Ut i 1 i zat ion 


57 




71 y^ 
y^ 6A 


li* y^ 
y^ 48 


^^^^^^ 


Practitioners 


67 




i>h y^ 


79 


73/ 








83 






0\/erall Re- 
ceiving Percent 
I nterpersonal 

— » — 




^^/^56^ 









- Based on fewer than M total mentions (i.e«, 2 p^Trsons times 2 mentions 
each times 3 media ratings)* . 



Key: / 
% as men- / 
tioned by / % as men- 
sender / tioned by 
/ receiver 
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Overall: Senders give 69^ Interpersonal media choices. 

Receivers give interpersonal media choices. 

"Interpersonal" Media = conversation, telephone, correspondence and memos. 
"Impersonal" Media = reports, journals, books, abstracts and summaries, 

conventions, guidelines and manuals. 
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TABLE 5.2b 



MENTIONS OF MEDIA LINKING FOUR GROUPS, SRS DATA 
(Mentions of Interp ersonal Media as % of Total Mentions) 



< 

cn 
o 
u. 

2: 
o 

UJ 

to 
a. 

Z) 

o 





Fede ra 1 
Pol i cy & 
Admi n i s t r . 


Research 
& 
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Di ssem. 
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Pract i - 
tioner 


Overal 1 Send- 
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1 nterpe^sonal 


1 ^ \Jw 1 CJ 1 ^ 

Pol icy & 

Admi n i st<.at i ve 


50 


72 


56 


liii 


^^0 




Reswear ch & 
Development 


52 


50 


53 


50* ^^/^ 
/ 50''- 


33* 

yik 

■ 


53 

/ 

/ 


Oi ssemi nat ion 
£ Ut i 1 i zat ion 


^2 


67 


37* 

50" 


50* 

17* 


20 y^ 
&7 


28 y 

y ^ 

/ • 


Pract i t i oners 


60 




92- ^/ 


80* 


77 y^ " 


75 . 


■ 1 




69 


^/^lOO'^ 


17* 




y A 


Overal 1 Re- 
ceiving Percent 
Interpersonal 




^8 











>Bpsed on fewer than 12 total mentions (i.e., 2 persons times ? mentio,ns 
each times 3 med i a ■. rat i ngs) . 
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Key: 

% as men- 
tioned byy^ % as men- 
sender y^ tioned by 
recei ver 

Overall: Senders give 56% interpersonal media choices. 

Receivers give 60^ interpersonal media choices* 



'Interpersonal" Media = conversation, telephone, correspondence and memos. 
'Impersonal" Media = reports, journals, books, abstracts and summaries, 

conventions, guidelines and manuals. 
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In terms of cross-group integration through use of interpersonal media, 
in the MA data the greatest integration (even with the discrepancy rioted 
above) is- for information sent from Federal P&A to Practitioners, though the 
reverse flow is not so integrated. In SRS, greatest integration is from 
Practitioners to R&D, though the base is small for mentions made by R&D staff. 

While the small samples restrict the amount of confidence given and 
attention paid to the particular results in the tables, particularly in the 
various cells, the analyses have demonstrated a potential for providing rich 
detail in overall use of different media by groups, own-other group comparison, 
input-output comparison, and discrepancies between perceptions of senders and 
receivers. Future e)^panded studies will be able to explore these dimensions 
in detail. Sub^sequent work should also seek to develop appropriate tests for 
differences for these rating data, an aspect we have not explored here, since 
our intent was more to examine the ability of the analysis model to generate 
variation, rather than to achieve statistical confidence in the specific 
differences obtained. 

The notion of mon i for ing^ the proportion of informal communication as 
an index of group integration deserves more exploration. We base this analysis 
on the assumption that as collectivities of individuals become interacting groups, 
the frequency of interpersonal communication should increase. Since inter- 
personal media allow for more complete and rapid communication, the group thus 
becomes more able to retrieve and share information (particularly that stored 
in brains rather than in documents). An increase in interpersonal communication 
should also indicate increased perceptions of community, identity, and belonging- 
ness. This irrdex may be two-sided, however: one needs to monitor interpersonal 
communication across groups to insure that any one has not become so well 
integrated internally that he is not talking to important outsiders. 

IV. CRISIS SITUATIONS 

A set of five questions asked for comments concerningc information use in 
specific situations which the user would describe as a "crisis.*' Respondents^ 
were asked to describe the nature of the perceived crisis, information needed, 
attempts to acquire such - i nforma t i on , , and to suggest ways in which information 
could be secured more e'ffectively in the future. 

A. DEFINITIONS, OF CRISIS SITUATIONS 

» We of te^K' heaV complaints abbut government by "crisis management^^?^he 
fireffghting effort of handlirfg one crisis after another, without adequate 
time for reflection, planning, or information seeking . Still, we have little 
.information on what persons in the Federal goverrl^nt, state governments, and 
'public agencies (including the research establishment) mjean by the word" 
"crisis." Thus, a primary concern for this part of our analysis was to take ^ 
a close look at the verbatim responses of our respondents, and in the process 
to devo Vop prel iminary coding schemes' for crisis situations. 

/ , » . ■ , •■ 

We asked respondents to identify their mos t ..recent work- rel ated crisis, 
and followed up with questions focussed on the i>af o rmat i ona 1 " as pec ts 6f the 
crisis. Let us begin by report ing verbat im what some of our respondents say 
are thei r crises . 
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For these descriptions we have developed a two-level code: first, we 
will separate out those crises which we judge not to be informational in 
nature; then for, the information crises, we will apply a scheme which notes 
the type of information and the "crisj's instigator" the person or group 
which touched off the situation. The distinction between informational and 
non- informational crises was often very fine in our coding, though we adopted 
the decision rul^ that the major component of the response would be used in 
malcing coding decisions. .Thus, if a respondent says his most recent crisis 
was, "writing a proposal for continued funding" we classify this as a "funding" 
crisis; but, \f he had said, "finding out what the gu i de 1 i nes^nd requirements 
J were for writing funding proposal," then this would have been coded as an 
informational crisis. 

Informational cris'^s are the' most frequent class, but' not the^majority in 
both agency's data. Here are some examples in ea(^h category. 

f A 

Fundi ng cri se s : Most of these responses are 'tSl'edi ctable: respondents in 
government mention crises such' as ^"a state mistake in submitting matching 
funds," or "attempt of private agencies to revise budget."'^ On the receiving 
end of funding, project and^ research staff most, often mention grant applications 
tight deadlines, and threatened or actual lossy of funds for programs and pro- 
j ects ... 

f 

Personnel, Interpersonal, 'and Intergroup Crises : This^ broad Category of 
human relations crisis ranged, from militant clients, racial tensions, and job 
disC-rimi nation to wage disputes, loss of jobs, and lack of cooperation among 
groups. Here are so^J^ examples': "Dembnstration opposing program for migrants." 
"School refusal to/^ovide data for a /study." "A staff member failed to do 
his job." -"Dispute over seniority and layoff during a cutback.-" "Comments 
critical of a program appeared in the news fnedia." 

Administrative or Organisational Crises : • These responses dealt with the 
difficulties of adml n i sten^ln.g , organizing, or getting work done: "Development 
of rules and regu 1 at i ons . f or a new law." "Scheduling of visits." "Senate 
hearing on oversight of prbgram." ' ^ 

Other : This small reoidual category contained two types of responses: 
.First, those who ^aid Lhey were in continual crisis;. and second, those who 
mentioned some natuV'jl disaster (e.g., a Vood) . 

-Informational Cri ses : Twenty nine (^1 per cent) of the MA responses, 
and 22 (33 

per cent) of those from SRS dealt with crises we coded as pri- 
,marily informational in nature. We have applied a two-component coding scheme 
to these respons'es: each response was coded for (a) the type^of information 
processed in defining the crfsis, and (b) the cause or instigator of the 
crisis. Since there were, in total, only 51 informational crisis responses, 
and since the two code components have six and five levels, respect ivel y ,. .we 
> 

c? , ' ^ • 



*These responses will be presented as direct quotes , a 1 though in some instances 
Vie have edited them to preserve respondent^' anonymity. 



cannot make any statistical statements about the response patterns. Rather, 
' ^e will use the coding to help us determine frequent themes. Table 5-3 
contains theSresults of this coding. 



TABLE 5.3 



A TWO-PART CODE FOR INFORMATIONAL CRISES: 
MA AND SRS DATA 



Requestor, Instigator, or Groups Mentioned as 
Source of the Crisis Situation 
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Knowledge 
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0 yA 
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0 


1 y/ 
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0 y/ 

yA 2 


k y/ ■ 

/ ^° 1 
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or 
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0 

^y 0 


0 ^y 
^y \ 


0 y/ 
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A' 

y "c 


0 • y/ 


0 y^ 

y \ 
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Programs 
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2 ^y 
y"^ 0 


1 ^y 

3 




0 y/ 

yi 


y 

1 y^ 

y^ 


"5 y^ 

y }- '"^ 


Plans 
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Project ions 
of 

Future 


5 y"^ 
yy\ 


1 y^ 

0 


0 y/ 




y 


7 yA 


Pol i cies , 
Regul at ions, 
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1 ^y 
y^ 


1 


0 y 


0 y 


0 y 


2 y/ 

y/ 1 
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3 
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5 

y^ 1 
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y^ 


0 ' y^ 
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,y 
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1 1 y^ 
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2 

y 
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yi 


29 yA 
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< 
z: 



CO 
CO 
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The information type code was developed so as to be similar to the "type" 
code used earl ier. The i nst igator/ requestor groupings were derived from 
inspection of the verbatim responses. Across both agencies, R&D information 
is most frequently tied to. crises: either in terms of finding out what is 
known, or in terms of telling someone (usually an agency policy maker) about 
R&D findings. R&D information in crisis situations was mentioned more 
frequently by SRS respondents.. Typical crises involving R&D and agency staff 
from SRS were described as: "Prepare progress report on alcoholism studies 
for higher levels," "Preparation of policy implications of research," and 
"Cr^sh assignment to notify office of Secretary of research findings having 
policy implications." There were no mentions of R&D crises involving agency" 
policy jjiakers from MA respondents, though they did mention crises involving 
pi ansS'r' project ions for higher-ups in the agency. 

If we concentrate for a moment just on the "instigator or source" 
'component ^f the crisis, we find that 65 per cent of the informational crises 
involve either agency staff or Congress. In fact, the response "preparing 
te^stimony for Congress," or "Congressional hearings," were very frequent in 
the data thpugh more often from MA than SRS respondents. Although we did 
not analyze the data to include the job role of the respondent at the same 
time, it is our impression that most of these comments come from persons 
employed by the Federal government. Thus, reporting to one's superiors — 
eitheV" in the executive or legislative branches — is a ''classic'^ definition 
crisis for quite a few of our respondents. 

Our coding scheme does not capture one important theme which ran through 
many of the crises, both informational and non-informational. This is time , 
or rather, the lack of it. Thirteen respondents (39^ of the respondents of MA 
and SRS combined) mentioned short or unrealistic deadlines or crash assignments; 
most of these from governmental respondents involved requests from or responses 
to policy makers. At the R&D staff level, short grant, proposal deadlines 
accounted for most of the time pressure (together with the push to write 
reports) . ' 

B. SUGGESTIONS FOR INSURING INFORMATION IN FUTURE CRISES 

The last question in the crisis set was put as follows: "Assuming such 
crises will reoccur in the future, what might be done to insure that needed 
Information is available?" Several broad themes run through the responses: 

(0 "Keep the copimun icat ion lines open." This rather vague 
suggestion is typical of a group of comments from 
respondents who clearly do not have any specific mechanisms 
in mind. Most of these refer to interpersonal linkages. 

(2) "Develop better information storage and retrieval systems." 

This set would depend on information systems for such diverse 
tasks as statistical and performance dala research findings, 
and management ihformation. Better data gathering systems 
were mentioned by several respondents, and could be coded into 
this set,. since most of these comnoents stressed a need for the 
capacity. to get and handle system-descriptive data. 
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"Better long range planning." This was a typical comment 
from those who mentioned a time or deadline press, or need for 
rapid responses to unplanned requests. In part this group 
is saying that if top policy maker's could project their needs 
better, and keep them informed, then the magnitude of crisis 
would be reduced. Some of the planning comments refer to the 
respondent's own job, however, 

"I have all the information I need." A few individuals took 
this approach, indicating the solutions to their crises did 
not depend on getting information, but rather, on doing some-- 
thing with what was already known. 

"Nothing can be done." Finally, a few respondents simply accepted 
crises of the type they had mentioned as part of their lot, ^or 
as unavoidable artifacts of the way the system works (or perhaps 
better yet, does not work). Such responses tended to occur in 
those crises in which unexpected demands, often with a high time 
pressure, were made. Inability to anticipate--particularly in 
regard to the requests of policy makers and Congress--was tied 
to some of these comments. 

C. STATISTICAL ANALYSIS OF "CRISIS" RESPONSES 

So far we have done very little statistical analysis of crisis. Below 
we will make a brief excursion into this area to analyze types of crisis by 
informet i-on needed, sources of information, and the "what can be done" 
question covered above. For this analysis, we have dropped the notion of 
source or instigator of crisis. Let us begin with crisis compared across 
the four job groups. 

There are differences here (in Table 5.^) within each agency by respondent 
group. In MA, Federal P&A and DSU respondents are high in mentioning informa- 
tional crises; Federal P&A are also high in administrative-organizational 
crisis mentions. Funding crises receive most mention in the DSU group. Among 
SRS respondents, Federal PSA staff most often mention informational crises; 
R^D staff are divided between informational and administrative-organizational 
crises, and Practitioners most often metnion administrative-organizational crises. 
The small numbers underlying the percentages should be noted, however. ' 

[Insert Table 5.^ here] 

In Table 5*5 we will drop our convention of analyzing by group of respondents 
to look at information processing according to type of crisis. 

'Part a^ of the table looks at mentions of types of information sought by 
.> respondents who indicated each type of. crisis. The point of interest here, 
as we saw in the verbatim responses, is the relatively low percentage of 
mentions in either agency of research-related information seeki ng--even in 
thos crises coded as informational in nature. In MA, informational crises 
produce regulatory or administrative information seeking. Administrative or 
organizational crises 1 ead 'to seek i ng administrative information most frequently 
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TABLE 5.^ 



NATURE OF CRISIS MENTIONED BY FOUR GROUPS 



1 


MA Groups 


SRS Groups. 




Nature of [ 
Crisis: 
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P S A 
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Pract . 
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39 


5 3% 


50 
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33 
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20 


50 


33 
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Fund i ng 


9 


15 


Ait 


29 


21 


7 


0 
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33 


21 


Other 1 

1 
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8 


0 


8 


6 


20 


0 


0 


0 


6 


f 

1 

> 


100% 
of 
22 


100% 
of 
13 


100% 
of 
9 


• 100% 
of 
2k 




100% 
of 
15 


100% 
of 
6 


100% 
of 
9 


100% 
of 
18 





In both agencies . In funding crises, however, MA respondents were most likely 
to mention seeking information directly related to fund-getting or budgeting, 
while SRS respondents most often responded to funding crises by seeking 
regulatory or administrative information. 

[ I nsert Table 5. 5 here] 



The next topic (in part b_ of Table 5-5) is that of internal vs^. external 
information-heed during crisis. T j^y f iy ^-poi nt scales were used to" assess 
the extent of^ informat ion needed from internal and external sources during the 
crisis mentkloned. The results show little difference using traditional tests 
of significance ( pairwise ^ tests) : only among MA respondents who mentioned 
administrative-organizational crises is there a tendency for greater need 
for i^fo^^7^at ion from within vs^. from outside. There are no statistical dif- 
ferences between agencies for intern^al vs_. external, or by crisis types on 
Internal or external in either agency. 



Finally, In part £ of the table,, we will look again at suggested solutions for 
I nformation-gatKe ring problems in future crises of a similar nature. MA respon- ^ 
dents give informational or administrative solutions roughly equal weight for 
each type of crisis. In SRS, there is more agreement on informational solutions 
for each type of crisis. 
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TABLE 5.5 



TYPE OF CRISIS 





MA 


SRS - 1 


a. 

Types of infor. needed - 
Research: findings, needs 


1 nf orma- 
t ion a I 


Admi n 1 s . 
Organ i 2 . 


Funding Other 


1 nforma- 
t i ona 1 


Admi n i s . 
Organ i z . 


Fun d i ng 


C t e H 


1 h% 


6 


9 


(2) 


1 8% 


12 


20 


(1) 


£ va 1 uat i on , performance 


22 


12 


1, 


0 


18 


18 


0 


0 


Statistical data 


39 


16 


9 


(2) 


15 


12 


12 


0 


rund ( ng 


8 


9 


41 


0 


0 


12 


20 


0 


Regulations, adminis. 


22 


kk 


18 


0 


^5 


36 




(3) 


Po I i cy , pi ann i ng 


3 


12 


18 


0 


3 


9 


a 






100% 
of 
36 


100% 
of 

32 


100% 
of 
22 


ment i ons 


100% 
of 
33 


100% 
of 
33 


100% (6) 
of 

mentions 

25 



Mean Extent to which infor 



was needed from : 
Inside own group 
Outside own aroup 
(5=high, 1-1ow) 



3.1 
3.9 



4.0 
3.2 



3.7 
3.8 



3.9 
3.8 



3.8 
3.^ 



4.0 
3.4 



What should be done: 



Better admin., organiz., 
schedul ing 

Better infor., dissem. 
communi cation 

Funds, legislation 



47% 
47 
6 



55 
45 



38 
38 

23 



12% 

59 

29 



12 
81 
6 



22 



56 



22 



100% 100% 100% 
of of ' of 

17 20 13 



100% 100% 100% 

of of of 

17 16 9 
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* Beseci on mentions, multiple responses allowed 
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V. ANALYSIS OF UNHET INFORMATION NEEDS 



Another approach to communication analysis is to determine perceptions 
of need. That is, regardless of the communications facilities, content, and 
contacts now available, where is the individual or graup "hurting" the most? 
Such an approach is obviously directly relevant to commun i cat ifOn system planning. 
In this study the needs section was placed late in the instrument so that it 
could serve as a summary, stimulated by all of the other questions we had asked 
about linkage. The approach to needs assessment is a simplified one, compared 
to that contained in the Mick, et. al. (1972) study of information needs in 
education. But the framework is the same: an assessment of type of information 
needed, source and media preferences, and an indication of the purposes for ^ 
which the information is required. WKi le Mick, et_. aj_. had sufficient information 
to pre-code the alternatives, in our study we were forced to ask the questions 
in an open-ended format. (Toward the end of this chapter we will specify a 
design for further work which moves in the closed-ended direction.) 

Types of need: In the MA data, a majority of the mentions of needed 
information (55% of 88) were coded as evaluative, performance, or statistical 
data. Thirty percent mentioned research or research-needs information. 
Among mentions by SRS respondents, the two groups of needs are cited with 
almost equal frequency (research findings/needs at ^6%, evaluative-performance- M 
statistical at 43%). Other need categories were rarely mentioned (see Table " 
5.6a). One MA (R&D) respondent sums up many of the characteristics of needed 
research information as follows: "A systematic, concise, usable update of 
all research in my area." These characteristics were echoed, in whole or 
in part, by many others. At the Federal level, research needs often mixed 
with other categories— (again an MA respondent): "pol icy oriented research; well 
conceived evaluation studies; and current, accurate performance data." This 
mixed response was fairly typical of many Federal Policy and Administrative 
respondents, who blended research needs with the next most frequent categories 
of performance and evaluation. 



[insert Table 5-6 here] 



As some of the comments indicate, there are differences in information 
needs according to job-group membership of respondents. In the MA data, 
(also in Table 5.6a) the Federal P&A group is highest in mentioning evaluative, 
performance and statistical information, followed closely by Practitioners. 
Not surprisingly, R&D respondents most often {kS% of the time) mention research 
related information. In SRS the pattern is somewhat different: while R&D 
respondents again indicate the highest need for research- related information 

of mentions), this need category is also the most frequent one for Federal 
P&A and Practitioner groups as well. Only the D&U group respondents break 
this pattern, giving more mentions to evaluative, performance and statistical 
informat ion. 
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TABLE 5.6 



TYPES OF NEEDED INFORMATION 



MA 



SRS 



a , 

Types of infor. needed 


Fed. P&A 




D&U 


Prac. 


Total 
% 


Fed. PsA 


R6D 


D&U 


r 

Prac. 1 

1 


Total 
% 


Findings, needs 


2h 


ks 


33 


2h 


30 


k8 


64 


33 


1 

kk 


k(> 


Eval uat i on , performance 
Statistical data 


61 




50 


59 


55 


hS 


27 


53 


i»l 


43 . 


Pol i cy , regulati ons , 
gui del ines , admini s . 


9 


15 


17 




13 


7 


9 


13 


15 


n 


Fundi ng 








— 


- 


6 


- 


- 


3 


3 




1001 
of 
33* 


100% 
of 
20 


100% 
of 
6 


100% 
of 
29 




100% 
of 
29 


100% 
of 
1 1 


100% 
of 
15 


100% 
of 
27 




b. 

Group from whom infor. 
should come: 






















Federal P&A 


6 1 


28 


23 


35 






0 


17 


17 




R&D 


9 


n 


0 


8 




5 


20 


8 


8 




D & U 


0 


0 


0 


0 




0 


10 


1 7 


8 




Pract i t i oners 


17 


6 


0 


19 




16 


20 


8 


29 




Combinations 


'3 


56 


77 


38 




37 

1 


50 


50 


37 






100% 
of 
23* 


100% 
of 
18 


100% 
of 
13 


100% 
of 
26 




100% 
of 
19 


100% 
of 
10 


100% 
of 
12 


100% 
of 
2k 




c. 

Medi a: 






















Forma 1 


79 


33 


1*0 


50 




68 


67 


55 


Sk 




Informal 


5 


27 


20 


33 




9 


8 


27 


23 




1 nterpersonal 


16 


ko 


^♦0 


17 




23 


25 


18 


23 




— 

1 


1001 
of 
19* 


100% 
of 
15 


100% 
of 
10 


100% 
of 
18 




100% 
of 
22 


100% 
of 
12 


100% 
of 
1 1 


100% 
of 
26 





^[^(^ * Based. on mentions, multiple responses allowed. 



Subsequent research, with larger and more representative samples, should 
explore these suggested differences in more detail and should search for the 
reasons for the possible greater need for research- rel ated information in 
all but the D&U group within SRS. Age of the system, nature of the field, or 
organization of the network might make a difference: i.e., SRS is a younger, 
more diverse agency than MA, and this fact may result in greater need for 
research information. 

Tab 1 e 5. 6b exami nes preferred sou rces for needed i nformat i on wi th i n 
each of the four respondent groups, but we cannot at the same time include 
type of information in the analysis. The table thus gives only source 
preferences. It shows that, for both agencies, the Federal P&A groups most 
often mention sources for needed information within their own broad group, 
while the other groups favor combinations of sources in most cases. Cross- 
agency comparison also suggests that the MA Federal PsA group is higher than 
its SRS counterpart in needing information- from other Federal PsA staff in 
the agency . 

The final analysis we will report here (Table 5.6c) examines media 
preferences for needed information in each respondent group. By and large, 
formal print media (articles, reports, etc.) are most often mentioned (by all 
groups in SRS, and by Federal P&A and Practitioners groups in MA). Inter- 
personal media would be used most often by MA RsD respondents, and formal 
and interpersonal media are equal for MA DSU respondents. 

Several respondents mentioned that their needs were^ not for more infor- 
mation, but rather, for more time, facilities, funds, or trained staff so 
that they could absorb and use the information they are now getting. Others^ 
indicated that quality or packaging were rrrcire important to them than quantity. 
For example, "The problem is quality and relevance, rather than form.. .it 
is how information is selected and 'packaged,' whether it is analytical or 
reportorical , etc., that is crutical , [rather than] questions of quantity.*' 
Thus, it becomes even more obvious that solutions cannot be built on the simple 
philosophy of providing m^re and more information. While we have seen in the 
comments that many d£ need more, others are indicating that structural or 
procedural solutions are required so that they can utilize the information 
they are getting now. - 

Again, the last two tables suggest interesting leads which can be followed 
up only when larger dsta sets are obtained and when an analysis can be made 
which uses an approach such as that which will be suggested at the end of 
this chapter. In the spirit of the pre-test, however, we have determined 
that the category system used for current information processing does an 
adequate job of coding information needs. Future methodology should, however, 
allow respondents to indicate needs other than information, or put information 
in the context of other needs. Also, provision must be made for those few 
people who say they are getting too much information. 
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-A more detailed analysis (not shown) revealed that 31^ of the MA Federal PSA 
indicated others in precisely their own group, so the other 30% are expressing 
need for information from different parts of the agency structure. In SRS, 
23^ of the Federal P&A indicated same group, leaving ]3% indicating others in 
thp agency. 
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VI. SUMMARY 



Throughout this analysis, we have made such limited substantive comparisons 
between the two agencies studied as seem warranted, given the nature of the 
samples and size of the data sets. In summary, however, we have noted the 
overall similarity of linkage mentions in the MA and SRS data, though media 
use patterns show SRS to be a less integrated system (through low mention 
of interpersonal media use). In crisis situations, we noted the small extent 
to which research-Dased information was mentioned as being sought during 
crises coded as "informational" in nature. Perhaps the pressure and immediacy 
of such situations mitigate against the somewhat time consuming process of 
seeking and adapting research to their solutions. The information need analysis 
showed SRS respondents most frequently need research information, with print 
media sources as the predominant delivery system. 

the profiles suggest MA as a system operating most often with data (on 
performance, etc) rather than more digested research findings, and doing 
so through established informal channels. SRS has not adopted this model, 
but expresses a higher need for research and a dependence on print. Three 
reasons might be suggested for this: (1) the newness of the SRS system, 
(2) its character (physical dispersion or topic diversity), or (3) the 
nature of the we I fare- rehab i li tat i on field itself. 



VI I . NEXT STEPS 



During the course of this project, it has become apparent that a linkage 
analysis approach to the study of DSU must be closely tied to the DSU 
model itself in two ways: (l) linkage behavior information collected from 
respondents must be in a form which allows analysis using the frarrework of 
the model, and (2) we must be able to compare attitudes about the DSU process 
with actual linkage behaviors. In addition, we must move away from rambling 
qualitative answer formats to methods capable of efficient processing of 
the extremely large data sets which are generated when we isk respondents to 
record communication behaviors. 



An example of our present thinking about linkage analysis methods is given 
in Figures 5<la and b. This technique expands on the simi lar method used by Mick 
( et . a 1 . ) , 1972, in their study of information needs. We have developed 
prototypical coding schemes for content, sources and receivers, media, and 
uses of information from which the respondent constructs frequent or impor- 
tant communications. The resulting data may then be used, with the mention 
as the unit of analysis, to analyze source-recei ver^content combinations that 
the model predicts we should find. Such analyses also would produce detailed 
descriptions of communication in the system which would be directly useful 
in processes designed to help managers and policy maimers develop changes to 
improve linkage where the data say it is weak. The data, given sufficiently 
large samples, could be aggregated together for each respondent for comparison 
of his linkage behavior with his attitudes about the DSU process, 
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Before one begins analysis of the very complex (at least 5 dimensional) 
data sets obtained in linkage analysis, it is necessary to have some guide 
to the potential descriptions and comparisons in the data. The first step 
is thus a notational scheme for linkage. A prototype scheme would be needed 
which defines the possible types of simple descriptions, intra-group rela- 
tionships, and intergroup comparisons. For example, an array of data identi- 
fied as SA'^B^n=l^'' relatively simple examination of all of the n_ types 
of content contained in those messages received by group B_ from source group 
A^, across all types of M^edia and Uses for information. At the other extreme, 
the notation scheme should also be able to define complex intergroup linkage 
such as "feedback," and, in betv^een, the modjarately complex analyses of a 
group's inputs vis-a"vis its outputs. Work is in progress on such a scheme 
at the present t i me . 

The pri mary dj f f icul ty with linkage analysis at present is not conceptual, 
but rather hinges on the fact that the mu 1 t i - d imens i ona 1 data are not con- 
ven i en t ly hand led by exi s t i ng s tat i s t i ca 1 compu ter sof twa re. Cont i ngency 
table programs collapse under the strain of five-way data solids containing 
literally hundreds of thousands of cells for all combinations of source, 
receiver, content, media, and uses. It is obvious that special programs 
must be developed to provide whichever aggregation of data the researcher 
desires, and which' apply Information theory or^arkov processes (or 0 combina- 
tion of the *two) , especially for input-oatput analyses and the more complex 
Intergroup forms, - . 

One proposal for detailed linkage analysis has already been submitted to 
the Mental Health Services Development Branch of NIMH, one of the two D&U 
units omitted from the present pilot test. Here, and in subsequent work, 
we would strive for a larger, more representative sampling of respondents. 
The twin keys to success appear to be (l) extensive pretesting of response 
alternatives In the linkage section, coupled with expans |gn of the DSU 
attitudinal Items, and (2) a carefully designed Interchange in which the re- 
sults are fed back to the agency In some coherent utilization program (e.g., 
coupling the results with the type of agency self-analysis spelled out in 
Apprendlx C ) . 

This brief description of next steps has revealed the extreme complexity 
Involved in doing comprehensive linkage analysis In a D&U system. This 
complexity cannot be Ignored, as It Is a part of the reality confronting 
any research on human communication. The results from the pilot study have 
Indicated that the method has the potential of providing much better data 
on the comnijuni cat Ion behavior of a system than we have had previously; next, 
assuming data collection and analysis problems are solved, we will be able 
to move on to system problem-solving activities based on the expression ^ 
of linkage goals and a comparison of these to the results of the analysis 
of current linkage. The result should lead to' more effective communication 
within the subject DSU systems. 



CHAPTER VI 



THE FEEDBACK-INTERFACE CONFERENCES 



I. INTRODUCTION 

The third majcr activity in this project was a pair of conferences 
held in late 1972 with the Manpower Administration and Social and Rehabilitation 
Service systems. These conferences had a dual intent: first, we saw them as 
a chance to gather additional data abouj: the two D&U systems involved, and to 
validate the information we had gained during the agency case studies and 
pilot surveys of linkage. Second, we hoped to initiate a prob lem-so 1 vip'^g 
activity within the agencies dealing with such difficulties as should be 
indicated either In the data or in the participants' comments. Conference 
participants would be selected to represent a broad spectrum of each agency^sr" 
D&U system. In this chapter we will describe the process-^ i nputs , and results 
of the two conferences. 

Only two of the agencies were chosen for conferences as it was felt that 
we needed to have a complete set of input data from^the system before going 
on to the feedback-validation conference model. This rationale limited us to 
those two agencies, MA and SRS, which had undergone both the case study and pilot 
study phases of the project. 

In the pre) Iminary discussions which led to the design of the conferences, 
we attempted to build in the following specific goals: 

(1) Each conference should begin v^ith true communication the 
development of shared meanings by providing participants and CRUSK staff 
with a common framework within which to understand and talk about DSU. This 
was tp be accomplished by use of the D&U model developed in the project. In 
part the use of the model was also a test of this new conceptual scheme: 
would i\t prove meaningful and useful to the participants? 

(2) Each conference should allow us to feed back both the qualitative 
data from the case study and the quantitative results of the pilot study of 
linkage, without creating a situation in which the feedback became cumbersome 

or overly-dominant in the conference. Again, the findings would be presented 
in terms of the model, where possible. 

(3) The conference setting would allow us to learn in more detail 
about D&U in each agency through the reactions of participants to the data 

sets and the model, and through the problem identification and solution-building 
activities to be included. 

(k) Each conference shoul d produce some progress toward problem 
deflnit'ion and the initial steps (if no more than the mobilization of concern 
and community building) toward the solution of problems.- 
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I 1. CONFERENCE LESIGN'V 



T 



The processes developed to ..reach the goals specified above produced a 
model for the conferences which combined the more common aspects of data 
fee^lback with a problem-solving sequence design. The re'sult was a model in . 
whicrt both'-CRUSK staff and participants would have an opportunity to make 
inputs. Although the design changed somewhat for the second (MA) conference, 
the basic model for both meetings was that of a two-day format, heavy on 
CRUSK inputs (the model and. the data) the first day, moving more toward work 
by, part icip^ts as one group and in sub-groups the second day. Our Inputs 
would begin with 'an exposition of our theoretical perspectives on DSU and the 
mode] currently in use, and then move on, to the data. Specific data Inputs 
would be the case study materials as coded into the model, the linkage-oriented 
pilot survey data, and compa rat f ve materials from other agencies' data. 

Interspersed with the inputs toward the end of the first day, and almost 
exclusively on the second day, participants would be assisted in the develop- 
ment of problem diagnoses, andfrom these, priorities for action and initial 
solution deveVopment . The outputs of the problem-solving groups were seen 
as Important products of the conferences which would, hopefully, be used by 
each agency to Improve Its'DSU sv^stem. Each conference would end with an 
evaluation of the meetings, designed to Improve our performance in such settings 
i,n the future. - 

Obviously, the design must reflect the needs, interests, and expertise 
of the conference participants. From the beginning, we had seen the conferences 
as a chance to bring together a wide range of individuals from each system, 
including agency policy, administrative, program, and DsU staff, RsD personnel, 
and representatives of important practitioner groups. Potential parti.ci-p^nts 
were selected from the samp-les drawn for us by the DSU units for the pilot 
study phase^ which had gr6uplngs of individuals In each of the at>ove cate- 
gories. Thtjs, we would not be selecting agency, research, 
or practitioner staff at random from the very loose systems in and around each 
agency; rather, we would be drawing attendants from those groups who had been 
important to tfie work of the agency D&U un-its, and who had had sytstantial 
previous contact with the unit. In addition to representatives i'rbm the pilot 
study samples, the D5U staff from each agency were to be Invited. 

With this brief ^overview pf the larger intent and design, we may move 
on to a more detailed description of each of the two conferences. The summary 
comments to follow dealing with the design and process in each conference are 
drawn from the tapes recorded at each meeting. The problem-oriented products 

' ' ■ ■ ' i 



* We. would like to thank Dr. William C. Morris of CRUSK for his valuable 
assistance in helping us design and implement these conferences. 

** Project funds paid for the travel and expenses of non-Federal employees 
for both conferences. 
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of group work presented beloyv ^re copies of the ch&rts and documents developed^ 
by participants during work sessions. These mater i aJ s were also distributed 
to participants after each conference. We will begin our^detailed description 
with the first conference (SRS) ; when we then turn to the MA- conference, we 
will be able to note changes in our design based on the SRS experiences. 



I. . THE SOCIAL AND REHABILITATION SERVI CE . CONFERENCE 



The two day SRS conference was held November 29 and 30, 1972, in Washington, 
D.C. with twenty-one part i cipants^^in attendance. Rough breakdowns of respondents 
into job groups were as follows: 

5 SRS Federal policy/planning, research and program administration 

staff " • . 

k SRS Federal D&U staff 

k non-Federal D&U staff .*! 
3 non-Feder-al R&D staff 

5 State and Regional staff « - ' » 

. .• ^ . 

There was, however, less clarity of job role division than this list suggests, 
especially among non-Federal participants, e.g., researchers who are also 
involved in -(or are doing reseacch on) DfcU, regional 5taff who were R&D 
specialists, etc. ' The agenda for the conference had been planned roughly 
along the lin<=*s mentioned in the previous section, although the des i gn' changed 
somewhat during the course of the me'etjing. The following description will 
concentrate on the. process, inputs, 'and outputs, presenting the productS'^of 
work g^oup^ as they appeared in the flow of the meeting. At the end 'of the 
description, we will talk afbout participants' reactions to the conference, and 
the suggesti-ons they made for improvement- in the format/content. 

After introductions, the conference got down to business on the morning 
of November 29 with a presentation from CRUSK staff about ogr approach to D&U. 
This presentation worked from the general to the specific, ending with an 
elaboration of the current D&U model. Discussion of broader points developed, 
taking up a portion of the allotted time, befor-e the detailed presentation of 
the model steps could be made. 

With this provision of a framework for D&U, participants then worked alone 
for a few ml.nutes to fill out a form (Figure 6.1) indicating their perceptions 
of the D&U areas being done best and vyorst in SRS now, and the areas most 
important to them. This activity, and the meetings to follow, were deliberately 
timed to break up the. CRUSK inputs into sessions separated by work by the 
partHcipants'. Homogeneous small groups were) formed (e.g., policy, D&U, 
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^*See Appendix; D for complete list of participants, 
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FIGURE 6.1 



CRUSK - UNIVERSITY OF MICHIGAN. 
Research Uti \ ization Conference " 
November 29 ,* ]972 

RESEARCH UTILIZATION SIX KEY TOPICS 



The figure below suggests six major topic areas which emerge when research utili- 
zation is viewed as an 'nter-systjem prob Ifem-so 1 v i ng dialogue. Review the questions 
posed under each topic an.i check one for each of the three questions in 'the left margin. 
Then jot down examples, observations, or othe/ specifiers which might be discussed in 
the group. ^ 



c 
o 
o 




Effective Performance and Problem-Solving In the SRS Mission d 

Do SRS users (consumers, practitioners, administrators, policy make rs) *^need 
any help fn their day-to-day activity which could come from R&D? «KWhat sort 
of R&D help do they need?.) - „ i- ' 



2. The RSD Knowledge Base . 

Does adeqifaJte knowledge now' exist to provide such help? (Quantity? Quality? 
Relevance?Cut i 1 Tty?) ^ ^ ' ' 



3. Uti I ization ^ 

Does existing R&D knowledge get used? (When? How oftfen? How? For what? 
by whom?) • * 



^. Knpw ledge Pr.oces>sing , ^ 

Is the existing R&D knowledge adequately translated and packaged for use? 
(Summar i zed? I nt eg rated?' De~jargoni zed?) , 



5. Dissemination 



Is existing knowledge transmitted to potent I a I ' users In the best way? (Are 
there enough books, pamphlets, magazines, journals, conferences, informal 
exchanges-, face-to-face consultations?) 
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6 . Need Communication j 

' Do needs of potential users get to the R&D producers? (is it clear what the 
needs are? ^ these needs Influence the work of R&D people?) 
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practitioners) to tally and prioritize the three dimensions, and to work 
from thTs basis to develop a list of problems relating to the highest 
priorities. The products of thre three sub-groups are given in Figure 6.2. 
It Is of interest that the D&U staff see dissemination as being done best 
in their system, but utilization the worst (and thus the most important 
area for work). This group then worked on defining utilization problems. 
Clients or oracti t loners showed no consensus on most important problems, but 
dlH indicate that need communication in effect, making the system listen 
to and heed their needs was not being done well. The client group then 
delved deeper into need communication problems, but in the discussion turned 
more toward microsystem activities, perhaps as the most efficient way to 
insure both needMComm^jn i cat 1 on and solution delivery. Such interactive 
processes appear closer to a prob lem-boi v i ng model of utilization, a model 
which has been historical ly (and as demonstrated in the literature review of 
Havelock, 1969) the most client-centered approach to DSD. The policy group 
shifted from topic area to topic area, picking out factors relevant to their 
needs. In. effect they wer6 saying they could not find one aspect of the 
model which was most Important, but rather were interested in all those things 
which could help them develop and administer better policy. 

In the afternoon of the first day, the sub-groups reported their outcomes 
to the group as a whole, and a clarification discussion followed. At this 
point, the agenda called for a shift away from the problem-solving sequence, 
and a' return to CRUSK inputs, which may have interrupted the flow of work. 
In the large group setting, CRUSK presented a summary of the pilot survey 
analysis of linkage, needs, and crisis situations (the same content, but in 
less depth, as was presented in Chapter V) Following the presentation, an 
attempt was made to have the large group derive implications from the d^ta 
and validate the results against their own experiences It appears, hov^ever, 
that there was not sufficient depth or detail in the data or in the presentation 
to'alluw this Implication-Validation task to work well. Participants were also 
both^Te^d by the different approaches exemplified by the case studies and the 
survey. Perhaps they were saying th^t we had given them a framework earlier 
(the model),, and now were asking them to look at DSU throug'h a di f ferent , mode 1 
(linkage or communication), and that this shift did. not meet their needs which 
were to talk about their own experiences and problems in detail. 

At this point the group was clearly not^ ready for more data input, 
specifically in the form of the su rvey ^rat i ngs of importance and actual provision 
of several DSU factors (the ratings discussed in Chapter VI I). Nor had they had 
sufficient time to^think about implications of the data or of the problem 
statements they had 'developed earlier. Several comments from the group asked 
for CRUSK he,l p in diagnosing D&U problems in SRS, and particularly for comparative 
data on what the f&ur agen ci es- stud led we're doing in this area. By this time, 
the OSU model had been presented, but we had not told the group specifically 
what we had found in th6ir agency relating to the points of the model. This 
omission was clearly indicated in comments from the group: they could neither 
Interpret our quantitative data, nor begin work on problem solutions without 
seeing themselves in the modeKthrough our eyes, and without sbmQ j ndi cat i on of 
what other agencies were doing. ^ 
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SRS FIGURE 6.2 

Group I - Policy People 
Wed. a.m. 



Best Worst Most Imp. Question 

11 1. Effective Performance and Problem-Solving 

n 11 11 2. R&D knowledge base 

(a lot of knowledge, but shaky 

in some topic areas and not 

evaluated scientifically, 

methodologically BUT some good 

things - more than being used 7) 



1" 3. Uti I izat ion 

n 1 k. Knowlege processing 

1 5- Dissemination 

1 1 6 . Need commun i ca t i on 
* 2 + 3 = 1 



TRANSLATION OF RESEARCH FOR POLICY ACTION 

-form of reports, size, presentation, etc. 
-research changes intent of work 
-f i ndi ngs 'themsel ves not liked 
-research needs and policy needs 

AUDIENCES FOR POLICY 

vary by topic area; not sure who Is listening, how; soft-sell needed 
POLICY MAKER NEED SENSE 

SENSING NET TOO NARROW - DON^'T LOOK Into other model s> f I e 1 ds 

CHARACTERISTICS OF KNOWLEDGE BASE 

-availability - access 
-science vs clinical model 

-relevance, generality, across time and location 

-applicability to system and needs (difficulty in extrapolating knowledge 

from area to area eg VR -MP, etc.) 
-integration w/non-sc i ence info (situational; individual case re: 

cl inical modeJ) 
-interface of knowledge base, policy and need sensing 
-lack of replication, external evaluation 

-2A0- * 
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Group II - Practitioners 
Wed. a.m. 



Best Worst Most Imp. 



Question 



111] 



11 



11 



1. Effective Performance and Problem-Solving 

2. R&D knowledge base 

3 . Uti I izat ion 

4. Knowledge processing 

5. Dissemination 

6. Need communication 



No. 1 Subtopic of No. 6 

New topic - long-range needs. 

Gulf between problem solvers and users. 

Even best research not utilized. 

Practitioners inability to identify his problem precisely. 
SKS research historically addresse^d to agency needs. 
Difficulty in turning problems into research projects. 

Subsystems may be doing own planning, etc. that may not affect total SRS system. 

Circle between universities and SRS sel f-peretuat i ng . 

Have to generate own resources to do research. 

Need for short-term planning efforts (6 months). 

Information not targetted properly. 

Two types of research: SRS funded - not relevant 

Not in SRS Research catalogue - social science research - not relevant 
No programmed way for SRS to carijjy out jnission. 

If state agencies had control ove^r resources, they could make information relevant 
to agenci es . 

Research people need to be part of management process. 

Need balanced effort between basic and applied research efforts. 

Need translation mechanism from basic to appl ied. research. 

Operations research - microsystem concept of irfvolvement of staff. 

Geographical boundaries affect resources possible. 

One RUS per region not enough staff for utilization. 

SRS research functions: I. to do research relevant to a number of states 

2. local needs in a community or a state 

Consensus on microsystem building - resource allocations to states and regions. 

BALANCE: I. resource allocation: central - regional - state 

2. model acceptance 

3. microsystem most important - interactive process ^ 
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Question 



SRS 

Group 1 1 I - D&U 
Wed. a.m. 

Best Worst Most Jmp. 

11 1. 
1 1 2. 
1 11)1 HJJ. 3. 

1 1 11 4. 

1111 5. 

1 1 6. 



Effective performance and Prob lem-Sol vi ng 
RSD knowledge base 
Uti 1 izat ion 



Knowledge processing 
Di sseminat i on 
Need communication 



Need more R&D on utiTization, more in terms of applied process than what is/is 
not used. 

Putting needs into researchable terms and without institutional bias. 

Need identification as well as need communication. This is foundation for RU. 

Knowledge processing: research may be relevant to needs but user can't make 

trans format ion . 
Practitioners must be made need sensitive. 

Knowledge base for SRS is often developmental and not useful for policy 
impl i cat ions . 

SRS hasn't learned how to coordinate resources for best results. 
Power relationships should be considered more. 
Model does not adequately emphasize linking. 

PRIORITY ISSUES: 

1. Measurement of utilization achievement - does it fulfill goals? 

2. What are goals? Need to be refined. 

3. How to coordinate (also system levels) resources for best achieve- 
ment of goals. Integration? Decentralization? 

^. User involvement in research process. 
5- Linkage efforts. 

6. Research on factors that promote/ impede utilization. 



Our original design was modified to present a comparative look at all 
four agencies in terms of the model on the second morning, together with the 
rating data. The profiles of SRS and MA ratings were given the next morning, 
but the discussion which followed did not build on the presentation. Rather, 
comments were broad and somewhat '*goalless." The discussion did become more 
focused when we began the four-agency comparative discussion, using the model 
as a framework. We progressed around the steps of the model, indicating what 
we had seen going on in that area in all four agencies. Participants would 
then respond with their own experiences and evaluations to flesh out particular 
points. It became clear that participants were able to make little use 
of either the quantitative data or of the model framework itself; what was 
proving most valuable was the chance to hear about their agency and others, 
and to be able to contribute their own knowledge in terms of D&U activities 
presented in the model framework. 

At this point the general discussion began to move toward solutions 
.what to do about problems the small groups had developed, the problems which 
had arisen during the comparative discussion. Participants were invited to 
indicate their interest in working on one of a set of problem areas, distilled 
by CRUSK staff from the previous day's discussion, or to modify the list, if 
necessary. Sign up sheets were made available, and two groups emerged which 
were sent to work on sol ut i on -bu i 1 d i ng in their area during the early afternoon. 

The specific tasks for the two groups were to (I) spend a limited amount of 
time sharpening the problems in the problem area which they had just chosen; and 
then (2) to spend the majority of their time developing potential solutions 
(action steps) for the most pressing problems, A list of potential mechanisms 
to facilitate and coordinate DSU was given to participants before they for^d in- 
to their two groups as suggestions or action "Idea generators*' (the list fs 
presented in Figure 6,3). J 

A wrap-up session was held at the end of the afternoon, during which the 
two groups (one which worked on need sensing, the other on solution delivery) 
presented their outputs to the total group. The newsprint sheets which recorded 
the groups' work were typed, and are included here as Figure 6.4 . These 
summaries were later mailed to all participants for their use. 

The' content of these summaries constitutes the most important output of 
the conference in terms of action statements for the system as a whole. In 
reading Figure 6.4 , however, it is obvious that the statements are not yet 
specific enough to be considered prescriptions for action. Participants recog- 
nized this, and somfe discussion followed regarding th^ cyclical process the 
small groups had followed: one problem area would be followed and pushed toward 
identification of specific actions, but before this point was reached the group 
would veer off, bringing in other problems which were related to the one under 
discussion. In part this may be the effect of problem solving within a very 
complex field. Also, this phenomenon may represent the fact that the participants 
did not feel comfortable in their role as solution builders: it is simply much 
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FIGURE 6.3 



Potential Mechanisms to Facilitate and Coordinate Knowledge 



Dissemination and Utilization 



(Suggestive listing - incomplete) 

1 . Organizational Structuring and Restructuring 

Extension-linking systems 

Overlapping organizations and associations 

inclusive organizations - professional associations 

Specialized linking organizations (laboratories, demonstration 

centers , clear! nghouses) 
Formal or informal information networks 

2. Roles and Functions 

Specialized linking roles: 

-to convey new knowledge 

-to develop knowledge for use 

-to act as catalysts for change 

-to act as consultants on retrieval 

-to act as consultants on change process as a whole 
Revitalizing and altering existing roles 

3. Temporary Systems 

Demonstrations j 
Seminars (traveling - stationary) 
Research utilization conferences 
Collaborative projects 

Simulation activities (role plays, games, system model 1 ing) 
Planning meetings ^ 

Specialized training focused on knowledge utilization and/or 
prob 1 em-scl vi ng 

k. Media 

Manuals on knowledge transfer, utilization, or problem-solving process 
Handbooks and compendiums on useful knowledge in given area3 
Training packages 

New journals, newsletters, periodicals, magazines, etc. 

Special columns or features in existing journals, magazines, etc. 

5. Information Technology 

Automated knowledge storage and retrieval 
User-oriented information systems 

Human resource banks and consultation referral systems 
Knowledge translation, derivation, recoding 
Knowledge packaging for use 

Procedural Aids . ^ 

Knowledge utilization or problem-solving guidelines, policies 
Knowledge utilization or problem-solving checkl i s ts, reorder i ng , 
remedial devices 

Subsidies for specialized utilization, problem-solving or retrieval 
activities -244- 




FIGURE^ 6.4 

SRS Conference - 2nd Small Group Meeting - 11/30/72 
Need Sensing (of Practitioners) 



I . Conceptual Framework to FacilTtate Need Sens 
A. Need, for conceptual framework for needs. 



_n£. 



1 



2. 
3. 



We need a statement of management objectives - means by which 

conceptual framework and integrated system can be developed - 

e.g., cost benefits, relationship of activities to outcome, roles 

and working relationships among staff. 

Legislative charge as they relate to needs. 

Relationship to objectives. ^ 

Who sets objectives based on needs. 

a. Administrators 

b. 

Sifting for appropriateness and prioritizing to avoid being overwhelmed 



How to strengthen need sensing. 

1. Need' sensing act i vi t i es . 
a. in state agencies . 

2. HEW conduct activities to assist administrative and other people 
i n*" agenci es i n need sens i ng ; t rai ni ng direct i ves . 

3. Technical assistance In language to identify needs. 
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Criteria and Measures^ of Needs to be Defined . 

A. Diagnosis. 

1. Needs of clients - "unmetness" 

2. Clients: 

a. Handicapped people 

b. Counselors 

c. Agency 

d . Admi n i strat i ve st ructure 

e. Community 

B. Identification of needs. 
1. Sensing should be accurate, uncensored and undistorted. 

C. Hierarchy of needs. 

1. Priority and utilization. 

2. Theoretical models - needs expressed in a theoretical model 
(e.g. Maslow); Field's "sense of agency." 

D. Measurement of Needs. 

1. Closure 5^stem - as a single means of measurement is inadequate. 

2. Suggest iotis-S other criteria i 

v;ays to measure client progress 
a long dependent to i ndependent 1 i ne 

3. Recommefid: need measurement and manifestation 
assign to an i nd i vi dua 1 within an agency . 
(-) too isolated - no involvement of larger group 

k. Evaluation, assessment, analysis of total rehabilitation programs. 
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2nd small group, Need Sensing 



III. Channels for Expression - All Levels 

A. Clients, counselors and administrators (interchange) 
. 1. Structure for manifestation (expressed by each) of client needs, 

counselor heeds, and administrative needs and all mixtures. 

2. System to brainstorm problems and cast into hypotheses and 
somet imes researched . 

Formal st ructure (channel ) 
Informal mean.s (individualized) , 
Example; local staff meetings. 

3. Means to meet needs 

a . Di rect 1 y 

b. Indirectly 

Importance of integrated jystem within state agency with expertise 
and skills of research to bear on diagnosis and filling of client 
needs (consciousness of staff) plus other outside resources. 

B. To overcome isolation* 

1. Concern re isolation of Feds ( central office !) from reality of direct ser 
vice delivery. State office isolation and dworcement from problems. 

2. Research utilization and information flow ".'n reverse*' - up to the 
admi n i strator . 0 

Example: Investigate the media. 

3. The more specific and/or isolated [the need] the less impact on^ 
administration. 

RU and needs on local level are considered low priority by administration 

5. Alerting researchers to needs; 
Translation of the expressed needs into research "problem". 

6. Visibility to non-VR agencies. 

C. Concepts . 

1. "Coupler" - an individual able to arouse, catalyze, mediate change 
and identify needs and transmit ideas. 

2. "Advocate" - one to an agency. 
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SRS Conference - 2nd Small Group Meeting - 11/30/72 
Sol ut i on Del i very 

I , Problem Statement : Solution (Alternatives) Delivery 

(NOTE: Some members of the group felt the term "solutions" was presumptuous. 
They felt that researchers couldn^t necessarily deliver solutions, although 
they could deliver suggestions for alternative action steps for dealing 
wi th 'a problem. ) 

A, Factors that should be considered in any SRS approaches to solution 
(alternatives) delivery: 

1. adequacy of dissemination media. 

2. diversity of clients (service recipients). 

3. clients - both agencies within SRS and SRS service recipients. 
k. possibility of over-emphasis on dissemination. 

(NOTE: One member felt that too much talk about dissemination 

per se might obscure the problem that getting the information out 
does not necessarily insure that the information will be used .J^ 
5. need for screening of information and targetting of information for 
speci f i c aud i ences . 

B. Final statement of elements of problem: 

1. disseminating existing information. 

2. finding information that fits needs of different user categories. 

3. packaging (e.g., transformation of information and selection of media), 
user adopt i on . 



I I . Problem Resolut ion 

B. Action steps for dealing with the problem of solution (alternatives) 
del i very : 



(NOTE: group members were aware that the time constraints precluded arriving 
at more specific recommendations and that, in this sense, the following 
suggestions are not really action steps but specification of areas where 
action steps should be developed.) 



1. develop groupings of research items to give user comparative idea of 
alternatives and suggest individuals to contact for further 
Information or assistance. 

2. identify and differentiate user groups and survey their needs. 

3. target dissemination activities for key user groups, 
k. organizational analysis. 
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5* involve key state personnel in utilization. 

6. Transformation of knowledge on regional level, closer to users, 
rather than on federal level. (This was further refined to recommend 
involvement of next user level in transformation activities, whatever 
that user level is.) 

7. Personnel profiles to aid targetting. 
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2nd Small Group Meeting 



8. Further experimentation with seminar method of introducing information! 
to different agencies or other user groups. 

9. Development and identification of different dissemination strategies. 

10. Development of follow-up and feedback monitoring strategies. 

11. Provision of consultation to users, 

12. Disseminators should suggest to users alternative methods of 
implementation. 

13. Cannot neglect engineering step of making information fit unique 
needs of any given user group. 

]k. Estimation of impact prior to decision to adopt (e.g., simulation). 

15. Rationalize reward system for innovation (e.g., verbal approval from 
state director for innovative behavior, differential payment, travel 
expenses) . 

(NOTE: One member pointed out the limitations of this suggestion, 

that is, that innovative individuals are usually not conformists 
within the organization they tend to operate on the fringes of 
the organization and administrators tend to reward the more 
conformist members because, by the nature of their job, they need a 
certain amount of conformity to hold the organization together.) 

16. Report on successful utilization activities with personal recognition 
of people involved. 

17. Personalize utilization process: "People-to-People." 

18. Research on impact of different packaging on different targetted groups, 

19« Get utilization issues into educational structure (e.g., college 
curricula on use of research). 

20. Develop research from common problems of user group and involve 
user group in research process from beginning. ^ 



easier for any group to continue talking about their problems than to 
commit themselves to developing solutions to them solutions which mean 
they themselves are going to have to behave differently than they do at 
present, and which require risk taking and the marshalling of support from 
both superiors and subordinates. Some specific recommendations for processes 
did emerge (for example, the moving of transformation activities to a point 
closer to users), as did recommendations for new DSU tools (e.g,, use of 
telephone as a rapid and Informal D5U medium). 

Further elaboration and task setting was not permitted by the lack of 
time available. The meeting came to a rather abrupt close, precipl tat'^-d by 
travel schedules and Washington car pool departures, without much discussion 
of exactly how the group products would be put to use. The SRS D&U staff 
did indicate that they would try to build the group' products into the 1975-1979 
"forward plan" for D&U activities which they were then developing. 

The final task of the meeting was that of evaluating the conference itself. 
Evaluation forms were given to participants for them to rate their satisfaction 
with each facet of the meeting, and make comments. A summary' ofv the evaluations 
is given in Figure 6.5 • These results show that the act i v i t ies \ i nvol vl ng the 
D&U model (its presentation, and D&U activities of the agencies presented in 
the model context) were relatively well received, though some would have 
preferred a pre-meeting written presentation of the framework. The problem 
generation and solution building activities also fared well, although the 
latter tasks were seen as somewhat too general and too forced by lack of time. 
ThecHeast attractive facet of the meeting was the presentation of the' survey 
resuTf^. This analysis was perhaps too long and complicated, and def in itely 
did not relate well to the needs of participants or to lihe remainder of our 
inputs. 

Several overall evaluation comments stressed the lack of a clear statement 
of purpose for the conference at the beginning, and others dealt with scheduling 
or mentioned that too much material was presented for the time available. There 
was also a theme of relevance of the materials presented, and that the ratio 
was too high in favor of CRUSK input to participant input.- 

Perhaps the most important part of the evaluation were the outcomes 
participants projected, i.e., the impact of the conference on them once they \ 
returned home. There is a wide range here, as might be expected. The most \ 
frequent type of comment deaU with applications of some specific portion of 
the model or concepts obtained in the participant's work; these ranged from 
planning through dissemination and microsystem analysis* Second in frequency 
were the "cognitive only" outcomes, those participants who mentioned the confer- 
ence as an asset to their thinking or knowledge, but made no specific mention 
of behaviors. Others mentioned such diverse topics as integration of their 
learning into teaching or training situations, and the value of contacts made 
at the conference. 



FIGURE 6.5 
[Compi led] 

EVALUATION FORM : SRS R^earch Utilization Conference 

/ 

1. How sat i sfied' were you with each of the following aspects of this conference? 
Please check whether you were: 



\f >f 



123^5 
Mean: 3»9 



1) Very dissatisfied 

2) Somewhat dissatisfied 

3) Neither satisfied or dissatisfied 
k) Quite satisfied 

5) Very sati sfied 



and give 
comments 
about your 
answers 



a. Presentation and discussion of RU model (Wed., a.m.) • 
Comments : 

Too much time allotted; projector/newsprint helpful 



123^5 

I 0 I I 1 1 1 2 1 111 1 1 1 I b. Discussion, ranking and comparison of major RU issues (Wed., 
Mean: 3.8 a.m. groups and posting). 

Comments: 



Small group beneficial; groups facilitated participation. 

123^5 

I 2 I rn \ 2 1 c. presentation of survey results (Wed., p.m.). 

Mean: 2.3 Comments : 



123^5 
□ □□□□ 



Too much time; i 1 1 us i ve-r i nterpret/select more; fail to 
relate results to what I could contribute; too many side- 
tracks; too long, diagrams too complicated (except graph). 

d. Derivation of implications (Wed., p.m. groups and posting). 
Comments: 



! 2 3 ^ 5 
Mean : 3-0 



Omitted 

e. Presentation on RU in other agencies (Thurs., a.m.) 
Comments : 



Not much actually presented on RU in other agencies; more 
detail on what worked where; greater detail; some. useful 
ideas; present in written form and save time for F; relevancy/ 
transferability didn't come through; would like hand-out 
material; need more formalized presentation and reduced^ 
audience participation during it. 

123^5 

I 0 irnr^ni 7 Ifn f. Discussion of ways to improve SRS RU (Thurs., a. 
Mean: 3*7 P-"i- posting of alternatives). 

Comments : 



. m. 



groups , 
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Small groups reinforce micro-system information exchanges 
each small group should deal with entire model; fask too 
open, product too general; here we get down to cases; output 
lacked specif icrty; not enough time; good interchange; more 
time needed; follow up with resolution sessions. 
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M. Think ahead to your return "back home." What impact do you predict 
what you did and learned at this conference will have on you and on 
your work? 



Will concentrate on microsystems--col laboration; apply concepts to 
need sensing' In' a project; try some of the ideas on dissemination; 
have a better conceptual model to plan dissemination activities; may 
have impact on research activities; look at macrosystem activities 
in region; helpful in planning; nothing immediate--may have long- 
range benefits. 

Contacts for future^, contacts ; appreciation of how R&D is seen in 
the "field"; awakeneds.40 cl i en t needs; increased understanding; 
conceptualization of model; insights to use in student seminars; 
curriculum development; training for practitioners re research from 
ut i n zat i on focus . 



III. What other comments would you like to make about this conference — 
contents, processes used, site, scheduling, etc.? 

Need more explicit statement of conference purpose, more small 
groups; purposes not clear enough; stress objectives for the after- 
noon group; clarify charge to group; purpose obscure, conference 
intent not clear. 

Tighten scheduling, or more time for discussions of SRS RU; smaller 
group sessions; ideas better _than models; too much to cover--schedu 1 
revision helped; time tight; too much faculty Input in re group 
input. 

Did not address primary SRS problems; discuss some RU case studies; 
need more meetings not in D.C. 



Thank you for your attendance. and for your comments! 

RJC ' . -251- 



In^summary, we felt this conference w^SiSomewhat hampered by the tight 
scheduling of too muqh input on our part, arrd a process which did not give 
participants a chance to make their own inputs early or oft^n enough. ^ Some 
of the«e learnings were built into the design of the MA conference, which was 
held a week after the SRS meeting. Unfortunately, one possibility, that of 
giving the participants the conceptual framework prior to the meeting, could 
not be implemented for the Second conference because of lack of time. 



IV. THE MANPOWER ADMINISTRATION CONFERENCE 

The MA conference was held December 7 and 8, 1972, in Washington, D,C, 
A rough count gave the following breakdown of the twenty-one participants:* 

6 MA Federal policy/planning, research and program administration 
staff 

5 — MA D&U staff 

2 non-Federal D&U staff 

^ — non-Federal R&D staff (although some were active in D&U) 
'4 State and Regional staff 

At the beginning of the conference, as participants arrived^ they were 
asked to answer two questions and to post their large answer sheets around the 
conference room. The questions were, "what is the most pressing knowledge 
utilization issue to me*', and "what do I expect to get out of this conference?" 
The responses were used to give participants a chance to identify people with 
similar interests, and to give the CRUSK staff a feel for the heeds of the 
group. In general, the responses to the first question were vague and abstract 
and those to the second centered on a desire fpr cognitive learning, although 
some expressed needs for more specific ideas about how to accomplish some 
(usually broad) task related to their job. 

In the introduction to the meeting, we were careful to specify clearly 
four purposes for the meeting (these were posted and in view during the »two 
days) : y,..^ ' 

(1) CO encourage dialogue in the group and between CRUSK and the 
group about DSU; . = • . " 

* * . . * ' 

(2) to share and confirm data from case'studles and linkage survey; 

(3) to Identify and prjoritize problems In DSU in the MA system; 

*See Appendix 0 for complete lis part ici pants . 
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{k) to develop first steps' for: problem solving on rmpor^ant problems, 

We stressed that the format was one in which we would strive to blend inputs 
from both the part i c i pants^j^ and from CRUSK. 

The first major input was the orientation , to our work and an introduction 
to the D&U mode-I , including the fit between the (older) work on identifying'^ 
theoretical approaches to DSU and the newer model. This presentation was 
similar to that used during the SRS conference, but shorter. 

Next, again following the agenda used for SRS, participants were asked 
to rate the six DSU problem areas according to best, worst, and most important 
(see Figure 6.^). Homogeneous sub-groups were formed to tally, prioritize, 
discuss, and identify problem areas. The outputs of these groups are 
contained in Figure 6.7- Because of the large^number of DsU staff (both 
Federal and non-Federal), two D&U groups were formed for this task. 

There was a feeling in the sub-groups, expressed during their subsequent 
report back to the large group, that the ratings were "relative'*; some part i ci - 
pants redefined the "best'* category into "least worst." Very little consensual 
agreementx^is ''found in or across the four. groups in the three Vating areasv 
with the exception that the policy 'and administrative group saw utilization \ 
as most .important, and that the two DsU groups taken together saw the R&D 
^knowledge ba^e 'as tne ETest (or "l.east worst") feature of the system. The 
problems identif>ied by the sub-groups ranged throughput the six questions and 
over the model steps^ In the report-back session tt/e low mention of need 
sensing -as a problem was discussed, and at least one. group noted that this 
a^'ea had been given emphasis in thei r ^di scuss ions . * 

\Next, we returned to inputs from the CRUSK staff in the form of the data 
on ratings of, DSU factors, and trhen presented the major points of the linkage 
analysis from the MA data in the pilot survey., in the discussion and clarif- 
ication which followed the§e presentations, introductory material was used 
relative to what other agencies were doing in th'e fte'ld of DSU. 

The final task of the first day was the beginning of small group meetings, 
according to sign up sheets, to work on problem formulation in^ selected DSU 
reas. The groups were encouraged to spend the remainder of the first day 
-firwing p'rob\lems, and ti' - to begin the second day in the same groups, but 
coaceot rat i ng more on dev'jbping solutions to those problems. These small 
groups. were not as representative of all participant job roles as we had hoped, 
h^eN)(er, since we had lost all but two of the Federal policy and administrative 
particjpant^ by the end of the first day. Loss of these i ndi vi dual s may have 
curtailed the transfer of need and problem statements from others in the DSU 
system directly to the policy-making level, an advantage normally gained in 
heterogeneous small group problem solving. 



We must look ahead to note that no one signed up to work on this area in 
the problem-solving sessions on the second day. 
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FIGURE 6.6 



CRUSK - UNIVERStTY OF MICHIGAN 
Resedrch Utnizatton Conference 
December 7-8, 1972 



RESEARCH UTILtZATION SU KEV TOPICS 
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The figure below suggests six major toptc areas which emerge v<hen researcH utiliza- 
tion is viewed as jn r n ter-sys tem problem-solving dialogue. Review the question;, posed 
under each topic and check one for each of the three questions in the left margin. Then 
^ot down tf )<..irir>les . ob'^ef vat » ons , or other specifics which might be discussed in the 

cgrt>up . 




I It teciivu Perlormance and Problem-Solving In the MA Mission 

Do MA users (consumers, practitioners, administrators, policy makers) need 
nny hfly in their day-to-day activity which could come from RtD? {What sort 
■ ;f RtO help do they need?) 



2 The R6D KnqUrledge Base 

Dfies adequate knowledge now exist to provide '>uch help? {Quantity? Quality' 
Reli'jon^e^ Uti I i ty?) 



i Ul i 1 I /.I I I oh 

Dofv ex( s t i nq RED knowledge get used? (Wherj? Mtw ollea?' Hnw? fnt wh.ii? 
By «^..m}| 



■ 2 



k Kimw U' J^> Pi^oCe-. ■ i 

J - ttw rxysrinq RfcO knowledge adequately tran iHti*<i .md p^ick-iypd f»ii use/ 
t lummri I i^i^tf I n t<*qt rj t cd? De - j argon I zed?) 

ei( I t \ (in kny^ledqe transmitted to potential u -'s ui |fu <w i w-iv? (An 
I •>(■ ' I- hfit>l^s , pamph lets, magaz i ne^ . juui ii.i I . <. ■ ■■. • i- 1 , n. i- . . ■ i f ■ n m,i I 

•^ ii If . I ,H I o - 1 acp mnsu 1 1 at i i>ns ?) 

\ * 

\ 

'~r>ii I'llv '.^ pi . t en I i ^ 1 u»ri.. yet tn t RfcD ni lului «'r ^ ? ( I ■- ri c l<'ar wh.it thr 
r,,.,v.| ,,i4»^ D< (hesiM. needs influonn' | hr iwniU -if H'.D i«oii|'lr^' 

\ 

\ 

\ 

I . t'. M<»,«jriir ? •'w^>> \i.^)mriun Leal ion h»^iweP" resf>aichefs .ind users on 
, . -t** -. , .lut ions? 

\ 

\ 

\ ' ■ ■ 

8 Mac rusys tew \ 

Is there a functioning natlijM^al system for research-based problem-solving 
in the manpower fie^hj?^. j;^ \ 
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FIGURE 6.7 

LABOR CONFERENCE 
Dec. 1972 

^roup I- Policy and Administrative 



Best Worst Most Imp. , Question 



11 1. Effective performances and problem solving in 

MA mi ss i on . 

-getting informed decision making 
-the problem 

1 2. The R&D knowledge base 

-eva1 ua te speci f i c prog rams but not the 

ent i re system 
-give program rather than policy 
adv i ce 

-lag time - re policy constrained now 

1 I 1 1 3. Uti 1 i zat ion 

-rewards missing for our work in getting 

uti 1 i zation at pol i cy level 
-how make them receptive (e.g., training 

for pol i cy makers) 

1 1 k. Knowledge process i ng 

-e.g., to program people - R&D doesn't fit 
for them 



1 ] 5 • D i ssemt nat i on 

-goose to community (1000) 
less to development commun i ty 
cong ressmen 
own po 1 i cy makers 
-how to develop an improved system to reach 
new decentralized system 

] 6. Need communication 

-no time for adequate surveillance 

I 7- Microsystem 

1 8. Macrosy s tem 

-training for new political appointeees 

re run system, user of R&D 
-develop linkages between information sources 

and pol icy deci s ion (working on this now) 
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f 4. 



LABOR CONFERENCE 
Dec. 1972 

Group I I - Practitioner 
Thurs. a.m. 

Best Worst Most Imp. Question 



1. Effective performance and problem solving 

2. The R&D Knowledge base 
1 3. Utilization 

1 11 k. Knowledge processing 

11 1 5- Dissemination 

6 . Need commun i cat i on 

"as users - no one asks us our needs 

7. Microsystem 

-conference and conventions are most helpful 
for dissemination of info 



8. Macrosystem 



Problems 

1. No communication from MA (we're not part of system - not receiving - except 

in informal sessions outside of system 

2. No mechanism to feed knowledge stored at fed level to region 

3. Existing knowledge is not packaged so we can use it - not transformed 50 

can be used: repts too long to read 

k. Breakdown of our (local) needs commun icatipn 

5. Turnover of programs is so rapid have no time to ^ass imi l^te them at local 

level 

6. Knowledge base at fed level have quantity, but not necessarily quality ' 
7- Imbalance in emphasis of programs with no carryover to sustain exch , 

8. Knowledg'e we have isn't used by decision-makers (e.g., Vickery report) 

9- Decision makers either ignore knowledge or adopt it in whole and 
change again quickly when it doesn't work. ^ 

10. Lack of training and refresher training at generalist level so can serve all 
people not just specialized programs, (me personally) 



er|c /^^^" 



Group I I 

Priori ty I tems 
Least worst 



Worst 



Mos t I mp . 



1. Microsystem 
(occas ional conferences 
and conventions in which 
there is informal dialog 
outside of formal sessions) 



1. Knowledge processing Stabilization of need 

and def ini tion'^ 

Dissemi nat ion 

(see: problem list items) 

2. Utilization 



^Emphasis: "Reoriented so much is disoriented" 

goals have shifted - problem redefintion 
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Labor 

Group III - D&U 
Thurs a.m. 



Best 



Worst Most Imp 



Quest ion 



]]] y 



11 



11 
11 



11 



1. Effective performance and problem solving 

2. The R&D knowledge base 

3. Uti 1 ization 

^. Knowledge processing 

5. Dissemination 

6. Need communication 

7. Microsystem 

8. Macrosystem 
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1. Macrosystem - no national organization 

2. Microsystem - can be used to involve user in research process from beginning 

3. RSD knowledge base - adequate to quite good 

k. User needs - feedback from service recipients important 

5. '*User'* - MA user groups extremely diverse 

6. Communication with policy makers badly done and important because they have 
power over funds 

7. MA has had particularistic emphasis in RU activities - need to be developed 

into more generalized system - macrosystem 

8. Model sections 1, 7, 8 are universal problems. Too general to be worked on 

useful ly 

9. Too much information 

10. Quality of research or of dissemination does not insure utilization 

11. Lack even a common terminology with which to discuss utilization 

AREAS Where Most Problems Exist : (Not^: This is not intended as an exhaustive 
TiTtl 

A. Transaction between dissemination and utilization: Linkage? adaptation? 

B. Political issues of KU - "We're not paying enough attention to these*' 

C. Define what R6D can do can't solve all our problems with R&D 
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Labor 

Group IV - D&U 
Thurs. a.m. 



Best Worst Mos t I mp . Question 





1 . 


Effective performance and 
problem solving 


1111 1 


2. 


The R^D knowledge base 


11 11 


3. 


Ut i 1 i zation 


1 1 


k. 


Knowledge processing 


1 1 


5. 


D i ssemi nat i on 


1 
1 


0 . 


Need communication 




7. 


Microsystem 


1 


8, 


Mac rosystem 


R6D knowledge base best because: 






1. MA and other RSD knowledge 







good quantity in most areas 

but some questions re quality 

to define problem, etc., reading, 

copi ng ski 1 1 s , motivation \ 
Ut i 1 i zati on 

Translation from basic to applied - bridges needed 
Worst: little evidence of use 

funding and dissemination not enough. Must build in utilization 
and technical assistance 

overemphasis on role of Information in triggering change 

don't know what gets used 

proprietary interests may create static 

end product, reflects deficiencies in other links 



Knowledge processing 

problem of knowing how to package 
software and hardware agents need guidance 
need to change roles - users and utilization 
not enough translation 
too much jargon 

but '*jargon" acceptable for precision and redefinition of concepts 

Dissemination ^ 
available information sits on the shelf 
need face-to-face sessions 
doesn't get planned or followed up . 
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Group IV - D&U 

Need communication 

major obstacle is insufficient understanding 

of needs of operating people - either perceived or real 
R&D insulated from user involvement 

Macrosystem 

further development of formal dissemination system 
Microsystem 

need for a model (both conceptual and working) 
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Participants worked in their small groups for the majority of the second 
day, returning for a report back and wrap-up session in the afternoon. The 
group products, in the three areas of utilization, knowledge processing, and 
microsystem building, are given in Figure 6.8 . Most groups mentioned the 
"cycling"' phenomenon discussed In the SRS section: small group members would 
begin moving toward the development of action steps In one problem area, only 
to Introduce related problems which would then be discussed In the abstract. 
In part, they felt that this might have beeH a result of the complex inter- 
action of problems In D&U. However, it was clear that some participants would 
have been happy to have spent all of their time defining and talking about 
problems themselves, rather than being pushed to design solutions. This problem 
might have been reduced had we had the continued participation of the policy 
and administrative group, and had they legitimated the task of developing real 
steps for change in the system. It was also suggested by CRUSK staff that 
part of the problem might be corrected if the group were able to develop better 
problem-solving skills before undertaking the task. 

One reasonably specific recommendation did come from the group working on 
utilization problems. This suggestion was for the development of a new role 
of "information specialists": persons to work at the regional level charged 
with communicating D&U Information to line managers In the MA system. However, 
the group felt that more information and constituency building were required 
before such a step could be advocated* In the discussion which followed, the • 
notion of a pilot test of this role In one region was brought forward. The 
similarity of this job to that of the SRS Research Utilization Specialist also , 
was pointed out . 

As In the SRS conference, the final step of the iDeetlng was that of evalu- 
ating the conference itself. A summary of the comments is given in Figure 6.9- 
In general, the evaluations were somewhat lower than In the SRS conference, 
except for the survey presentation (which had been kept very short), and which 
was rated highest In this conference. The fact that the inter-agency comparative 
materials were linked" Into this presentation appears, from the comments on this 
rating, to account for much of the difference. It Is interesting that the 
problem-solving activities, which were second In high ratings only to the model 
presentation In the SRS conference, were the lowest rated in the MA meeting. 
It becomes apparent from the cjomments, however, ,that the frustration of attempting 
problem solving Is the difficulty, rather than the Idea of solving problems 
itself. 

Turning to the general evaluative comments, again we found several remarks 
pertaining to scheduling, timing, facilities, etc. The more general comments 
mentioned problems ranging from participant select Ion , thei r cooperati veness , 
etc., to those Indicating that participants might have been more satisfied 
had they been given more responsibilities In designing the process of the^meeting. 
Again, the desire for more descriptive and comparative data was expressed. 
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FIGURE 6.8 



Labor 

Utilization - Small Group 
Thursday afternoon and Friday 



A. Ut i 1 ization 

P rob 1 ems : * / 

-getting decision maker to use knowledge (form not useful?^) 
"even after being repaqkaged 

-staff capacity' 

-guidelines, regulations, etc* don't permit us enough flexibility 
-finding out where utilization is now going on: tracking 

-what is definition of utilization, e.g,, how does DSU staff decide when 
knowledge has been utilized? when others take over; never satisfied; 
development of program which is transferred to user system and replicated 

i 

-money--key in reaching decision makers 

4 

-decision alternative of adopt vs "do what I'm supposed to do" 

''-role definition problen^s? 

-what does role allow/encourage person to do in terms of going 
out to give/get information 

-building into research project a utilization role for the researcher 
(first need mechanism to decide what appropriate ut 51 ization role 
should be for given research/project) 

-DSU staff forced to take unevaluated products and get them used 

-with decentralized system regional of f i ce shou Id be more active--but RU 
is still nat ional 
CRO's don't want to use research 

-lack of support staff (secretary) in DSU unit 

. -No c]out--DSU, US'ES 

-no operat ing arm 

-difficult to reach political appointees within regional office areas 
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-local area Manpower planning advisory board operations within 
different city power structures (e.g., strength of mayor) 

-how to get decision maker here to make decisions based on vali 
knowledge 

-we (DSU) will have to know local conditions and needs better 
(e.g., labor market information) 

-have not reached 1 i ne ^uthorl ty - D&U gets to staff people (e.g*, 
manpower administrators at WIN, regional, state levels) 

-difficulty in establishing regional R&D ut i 1 i zat i on contact person 

V 

Wrap-Up 

1 . Reach i ng key dec! s i on make rs 

-line administration at all levels 
-Washington, state, regional offices 

2. Capacity 

-staff secretarial - 

3. ^Utilization roles for researchers 
k. Tracking utilization efforts 



RSD Linker Staff - Decentralized 

Brainstorm Alternatives for: 

more than one RsD guy per regional office 

1. Decision makers potentially reached 

a. regional MA 

b. state agency administrators (employment services) 

c. prograin sponsor/operator (NYC, CEP, etc.) 

d. area manpower planning (potential) 

e. pressure groups 

2. Linkages , e ■ 

-field to Washington RSD (tie to technical assistance and 

t ra i n i ng) 
-R&D to decision makers 
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3. Locat ion 

Regional office (e.g., SRS, R&D specialist) Use existing system- 

TAT centers other agencies 

State (e.g,, SRS RU specialist) 
' \n area plan groups (±300) 

How to demonstrate need for new role, i.e., show lack of information 
flow/use to DMA, RMA, etc. 

-document results from present projects 

-collect experiences' of regional office project, Rsp, etc. staff 
which show the gaps --present in way a task force does? 
-use our work here, as a group. 

Volunteer region to pilot role. 



B. Labor 

Knowledge Processing - Small Group 
Thursday afternoon and Friday 

Problem: 



Getting users (arbitrarily limited to state and local level) to adopt 
R&D f i ndi ngs . 

1. going through existing non-federal associations with existing 
dissemination systems. 

\ 2. go through regional office because RMA's control funds 

3- multi-agency network -- tie in with SRS, OE, etc. for Information- 
technical assistance, etc. 
■\ ■ ' : 

^. direct access to users - with some items 

' ' , .■• 

E&D project in regional office to find out how to better Use retgional office 
in, R&D dissemination and util.'ization . . 

-t-ie research in with needs ' .■ ^ 

-cassettes, video, etc., ' , 

-identify user for par'tiicular research item * • 

" -find out who's doing what in organization - subject areas' 
-special conferences at regional level 

HOW? Who? It depends: 
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Refined Problem Statement 



K Development of criteria for identifying users; use of research 
base in this task. 

2. Implementation of criteria / 

USER GROUP: ' / 

/ 

Knowledge processing group 

How do we get users to adopt successful training program - users are on 
all levels - federal, regional, state, and local 

Knowledge Processing 

3 general categories of problems within knowledge processing area, ranked 
according to priority: 

1. users - identifying, surveying needs, etc. 

2. system constraints - funds, resources, politics, etc. 

3. media (bot;h media and communication channels) 

1. User category: Problems 

-knowing enough about users to know how to package information; 
-getting information into form and language that users can understand 
and use; 

-finding out how users integrate research knowledge with other things 
they know; 

-finding out how users transform information into knowledge; 

-i dent i fy i-ng users who could benefit from information and packaging 

it to be most usable to them; 
-involvement of usKr in R&D process from start and at every level: 
-stimula^-ing users to actually apply knowledge; 

-making sure top-level people know what the fl^l^d people are doing; 
-narrow definition of knowledge. Researchers are not the only 
knowledge producers; users produce forms of knowledge also. 

2, System. Constraints Category: Problems - 

;.-inaccess ibi 1 f ty of people who control funds. They talk to their 
own level of people and other levels can * t get access to present 
views, etc. 

-knowledge processing strategies must take Into account the "pecking 

order" - status problems; 
-need for interagency training and information exchange (there are 

overlaps and duplication of effort and responsibilities). 
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3. Media Category: Problems 

-what are appropriate media for what kinds of information and 
audiences; 

-forms of packaging must be convenient to carry around, etc. 
-Re Table 1: Why aren't things happening in the various low- ^ 
interaction channel s? 

Unci ass i fi ab le 'Overview' Problem 

-what are criteria for choices that must be made when selecting 
knowledge to be disseminated? • - . ' 

Criteria for Solution-Building 

1 . speci f i ci ty 

2. personally involving 

3. realistic; capable of being accomplished 
k. observable; measurable 

5. other o ; 

Specific successful WIN training program - How do we disseminate th(l^e 
results to. field people on federal , regional,, local-state levels who ^ 
actually run the program? 

Alternative Solutions: 

Specify in research contracts how information will be •jsed--def ine 
specific kinds of people' who can use it and how they can use it. 
"How to" manual. Contractual requirement that contractor have 
orientation period in the field to understand user needs. 

1. categorization of criteria - different ones for different 
audiences, products, etc. 

2. specif ic' instructions for'action with piece of information 



C. Labor 

Microsystem -'Small Group 

Thursday afternoon and Friday morning 



MICROSYSTEM GROUP . . ' 

(each element 
on policy makers Reach enough people without swamping them 
on 1 inkers 
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2. Dim^rnsions of microsystem - spectrum 

3. Different system for different users 
Internal communication of users 

I . Regional Utilization Network Conference 

1. Knowledge users and needs considered separately instead of produced 
with user in mind. (e.g., why be concerned with users and ut i 1 i zat i cJis^ 

2. Manpower planners (governors and mayors 'offices) 

Lack clout 
Duration 

Don't perceive self as disseminators 

3. Presentation of information 

(Knowledge processing in transformation - how many different kind*; 
can be handled) 

k. Lack of personnel with writing skills and resources - poorly prepared 
material ^ user not served well 

II. SoTC groups for which establishing linkages is problematic, for others not. 

Problem of their perceiving our utility to them - different attitudes 
-bui 1 di ng t rust 

-policy formulation types are problematic 

-operating groups are not ' ' , 

, . --need communication for policy makers problem * 

(courtship of --presentation to them is critical 

policymakers --pe rsona 1 i ty p rob lems 

^ X ■ --bureaucratic problems 

microsystem) 

III. "Court^hi p" ■-''Local Resistance to Research 

-fears that bt is evaluation 
' ■ -lack of trust ^of researcher 

-overload .claim ^ ' ' 

-defens i veness-- ! ack of openness and cooperation 
y -poor report rewards for rnem --little or no feedback 

-imposition rather than joint effort ' 
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EVALUATION FORM: 



FIGURE 6.9 
[Compi led] 

MA Research Ut i 1 i zat i on ' Confe rence 



1. How satisfied were you with each of the following aspects of this conference? 
Please check whether you were: 



1 ) Very d i ssat i sf fed 

2) Somewhat d i ssat f s f i ed 

3) Neither satisfied or dissatisfied 
A) Qui te sat isf ied 
5) Very satisfied: 



and give 
comments 
about your 
answers 



•^f X 

12 3^5. 
I 0 innnnfTirn a. presentation and discussion of RU model (Thurs ., a.m. ) . 
Mean: 3,^ Comments : 

Too abstract; participants already knew subject area; parti- 
cipants (non-D&U) .should have been briefed on report on 
model before; npt tied .in with actual problems; "probably 
useful 'for providing a common understanding base to start 
from, but not exactly i-nspiring." 
I 2 3 A 5 \ ' 

I 1 1 1 0 I I ^ 1 1 6 I rn b. Discussion, ranking and comparison of major RU issues (Thurs., 
Me^rt": 3.5 groups and posti.ng). 

Comments : 

■Group cqmposi tion' deficient to task, needed more policy 
makers aPTd administrators; should have had more discussion 
by total group'of postings, 

12.3^5 

|0||2||2| |6 H2| c. Presentat ion ,of survey results (Thurs., p..m.)\ 
Mean: 3-7 Comments : 

Good comparison revi-ew; good material, content rather well 
organized, graphic aids well done; need CRUSK's analysis, 
of resu 1 ts . ' , , . 

J 2 3 4 5 ' - * . ' < 

I 1 1 I I I ( II I d. Derivation of implications (Thur^s., p.m. groups "and post ing) . 

Comments : . 



2 3 ^ 

Zinc 



1 -^"2 3 V 5 



Mean: 2.8 



Omi tted 



[] e. Presentation on RU in other agencies (Fri., a.m.). 
Comments ; < " 



Omi tted 



f. Discussion of ways to improve MA RU (Fri., a.«m. .groups, p.m. 
posting ov alternatives). ^ 
Comments : ' , - 
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D'f sappoi nted group could not at least begin to define one 
problem in utilization and suggest solutions for'it; some 
o'l the most useful part of conference, needed more user 
participation; "conference convenors need mire cpngenial way^P 
of 'coaxing'- thought out of participants, but they were 
'screwed' as always in in-city conference by heavy fall-out 
of senior (status) MA , parti ci pants**; as new rjiembecs arrived 
focus on problems and solutions changed; go6d start, but unless 
there is some direct follow through , s i mo 1 y another e.xercise in 
futility, L268- . - i , 



II. Think ahead to your return "back home." What ''impact do you predict 
what you did and learned at this conference will have on you and on 
your work? 

Confirmed necessity that R&D must be accompanied by statements 
as to how these findings will help meet user's needs in resolving 
the i r p rob 1 ems . 

More emphasis on utilization activities for project; may get some 
representation for utilization in one regional office. 

Better expression of R&D local needs; more sensitive to user needs and 
react i ons . 

In long run, a mechanism for conveying at least a part of the R&D 
action to field; more consciousness of R&U department and different 
look at materials that come across my desk; reinforced about wide- 
spread concern about lack of adequate utilization knowledge, at 
least I know I have a ref e ren t g roup . ^ 

Will be useful in training;' review research material to see if can 
be applied more directly in local area manpower planning; an "insidious" 
influence on my behavior in this and related areas; stimulation to 
reconsider and replan; general suspiciousness about conferences. 

III. What other comments would you like to make about thi s ^conference con- 
tents, processes used, site, scheduling, etc.? 

Better care in selecting participants; con*:ent and processes which 
were planned were OK, however, not all partici pants understood (or 
cooperated with) what was expected; conference format was autocratically 
imposed, suggest more participation in planning conference procedures 
by participants, more emphasis on how other agencies deal with specific 
p rqb 1 ems ; more input from Bill Morr i s ; good- - fol 1 ow-up i mpera t i veJ,, 
suggest visiting some successful projects to either confirm or dil^agree 
with some of the prob lems stated in th i s conf e rence . 

Longer conference, more concrete solutions to utilization problem 
could have been proposed ; .more time for "sink-in" of new materials, 
"new" ways of thought engendered or rekindled in participants; tight 
schedu 1 e , had to absorb new te rms , vocabu 1 ary , and peop 1 e in un- 
familiar areas of work; break earlier, needed to get back to office 
to pick up pieces; main conference room too hot; better physical 
f ac ilities; get out of D<C. 

Small group work and stimulation of small sessions was well done; 
tasks never defined in practical terms, "What is R&D?," jargon, 
Washington people (ivory tower academics) never ^hown off to worse 
disadvantage, were not allowed to get down to practical matters, felt 
so fofced to conform to arbitrary rules that creativity inhibited; 
divisi'on of subjects for discussion seemed unreal, this skewed the 
whole thJng. 



O Thank you for your attendance and for your comments^ 
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Finally, the question on use of conference learning back home shows the 
MA respondents to have had somewhat less of a tendency* to turn their learning 
into concrete expectations than did those at the SRS conference. Still, however, 
sensitivity to concepts and other groups, and the value of the conference in 
augmenting communication per se are mentioned more often than are behavioral 
changes. We would be well advised to take the advice of some of the partici- 
pants, as seen in the evaluative comments, that follow-up is essential if the 
experience is to be more than an ''exercise in futility," At the meeting, and sub 
sequently in reviewing the group products and evaluation forms we have sensed a 
real desire on the part of many participants that the outcomes of the conference 
actually go^ somewhere, and that someone take the responsibility to move the 
rudimentary problem solutions toward the action stage. This real commitment 
to action would, no doubt, relieve many of the more negative feelings expressed 
in the evaluations, particularly the relatively low evaluation of problem solving 
as a rewarding activity in the MA system. 



V. CONCLUSION 

We will not attempt to recap the major outcomes of each of the conferences 
here, since so much space above has been devoted to just this. Rather, we 
would like to conclude with a note on interface conferences as a potentially 
valuable micro-system building activity, in this case, development of a micro- 
system to work on macro-system DsU problems. These two sets of conference 
participants may be seen as an important core for a cont inuing D&U problem- 
solving activity. Their diversity in job role helps guarantee they could 
serve to bring together all of the diverse perspectives on the D&U process in 
the system. They would serve as a useful sounding board for potential changes, 
a legitimating group for action trials, and a source of support for individuals- 
trying to implement change on their own. 

Such use of Lhese groups would encounter, possibly, different difficulties 
in the two agencies. In SRS the group would have to work' hard to develop a 
sense of community beyond the DSU process itself, given the content- research- 
program diversity in the system. In MA, the group would have to work hard to 
interest top level policy makers in actively p'art icipat ing in the group, and 
such participation is essential for the group to keep its active members from 
being cooled out by the frustrations of the change-building process itself. 

It was a matter of some frustration t;o the CRUSK staff that the MA con- 
ference received lower overall evaluation than the previous SRS conference, 
this despite our greater effort and care in preparation and our redesign of 
lowest rated segments. Subjectively, we felt that 'cjoing our job 

better the second time around. This was confirmed for the data presentations 
but not for any other segment. We also felt that MA pa rt i c i pant s we-re more 
critical, more dubious about group problem-solving, and less inte/rested in 
building a collaborative network with each other. They also->seemed to expect 
that all inputs should come from CRUSK rather than from themselves. 



It IS not at all clear to us why these differences between the two 
conferences emerged. It may be that Manpower and SRS systems are simply 
different in these respects. It may also be that the peculiar mix of 
21 individuals from the two systems represented a collection of very 
different personalities. On the other hand, it may be that the CRUSK team 
performed more poorly than their self-perceptions would allow them to 
believe on the second occasion. We have also cited the attrition rate of 
higher level personnel in the second conference which may have disrupted 
or demoralized those remaining. 
# 

Clearly it is important to be aware of these differences and to con- 
sider the relative receptivity to problem-solving and^D&U conferences by 
different systems since such reactions will have great implications for the 
overall strategy of the federal D6U unit in an agency like SRS versus 
another agency like Manpower. 



\ 
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CHAPTER SJ\ I 
THEORY VS. PRACTI CE 



One major objective of this project was to compare overall strategies 
and philosophies of change as exemplified in different research dissemination • 
and utilization systems. The foundation for such a comparison was laid in 
an earl ier- work (Havelock, et al . , I969) which reviewed the literature on 
change and identified three clusters of change ideology from an analysis of 
twenty-four prominent theories (Havelock, et al., 1969, Chapter 10). In 
this chapter we will attempt to compare propositions derived from previous 
theory and research wtth "ext'st i ng attitudes and perceptions of reality 
exemplified in the four agencies and (for two of them) their associated 
networks. The Chapter will be divided into two sections. The first com- 
pares the four agencies on their responses to a 20 item checklist representing 
various dimensions of ideology and strategy. Pn the second section, we pro- 
pose a ten-part rating schema for analyzing important process issues in a 
D&U system and test this schema by means of a content analysis of interview 
respons;^s from the Manpower Administration interviews. 

I. DIMENSIONS OF IDEOLOGY AND STRATEGY 

— • 

A. BACKGROUND AND RATIONALE 

As noted above, there is a considerable bulk of literature dealing 
explicitly or implicitly with theories and strategies of change, innovation, 
dissemination, and utilization. For example. Chin and Benne (in Bennis, et al . , 
1969, Chapter I.3) identify some s ixty theories of change, cluster i ng- them 
in three broad categories of "rational-empirical," "normati ve-reeducative,^' 
and "power-coercive." In our previous work (Havelock, et al., 1969), we de"* 
rived a similar schema in attempting to summarize findings from over 1,000 
studies and at least 100 different theoretical contributions. We found that 
most of the strategies discussed in these sources could be grouped conveniently 
under three headings Which roughly fit the designations, "Research, Development 
and Diffusion," (RD&D) , "Social Interaction" (S-l), and "Problem Solving" (P-S) . 
It was not our intention to recommend any one of these models over any other, 
but each seemed to represent a distinct, important, and va 1 i d perspective on 
the process as a whole. We further proposed that the most satisfactory strategy 
of DSU would take adequate account of each perspective. Because these cluster- 
ings were of such importance in the thinking which ]'ed up to this four agency 
study, -1 brief synopsis is included below by way of introduction to our survey 



f i nd i ngs . 



1 . Research , Deve 1 opmen t , and D i f f us ion ( RD&D) 



This model is guided by at least five assumptions. First, it assumes 
that there should be a rational sequence in the evolution and application 
of an i n nova t ion . Tb 1 s sequence shoul d i ncl ude resea rch , deve 1 opmen t , 
and packaging before mass dissemination takes place.* Second, it assumes 
that there has to be planning, usually on a massive scale ovfer a long • 
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time span. Such planning and ordering of stages from initiation to 
the achievement of stated objectives allows for systematic budgeting, 
monitoring, and scientific evaluation at each stage. Third, it assumes 
that there has to be a division and coordination of labor to accord 
with the rational sequence and the. plann i ng. Fourth, it makes the 
assumption of a more-or-less passive but rational consumer who will 
accept and adopt the innovation if it is offered to him in the right 
place at the right time and in the right form. Fifth, the proponents 
of this viewpoint are willing to accept the fact of high initial develop- 
ment cost prior to any dissemination activity because of the anticipated 
long-term benefits in efficacy and quality of the innovation and its 
suitability for mass audience dissemination* 

Prototypes of this RD&D model are presumed to exist in industry 
and agriculture. Figure 7.1 provides an outline of its major com- 
ponents. 



FIGURE 7. 1 



The Research, development, and Diffusion Perspective 
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With regard to federally supported R&D in education in the mid and 
late I960's, major advocates of this viewpoint have been Henry M. Brickell 
(1961), Francis S. Chase (1968), and david L. Clark and Egon Guba (19^5 
a and b) . t 

2. Social Interaction (S-l) 



This model places emphasis on the patterns by wh 1 ch j nnovat I ons 
diffuse through a social system. Five generalizations about the process 
are usually emphasized and are supported by empirical research from 
educa t iona 1 , med i ca 1 , po 1 1 1 i ca 1 and ru ra 1 soc i o logy and from anth ropol ogy , 
communication, marketing and public health; (l) that the individual 
user or adopter belongs to a network of social relations which largely <> 
influences his adoption behavior; (2) that his place in^the network • 
(central 1 ty , per i pheral i ty j sol at 1 on) is a good pred ictorofhisrate 
of acceptance of new ideas; (3) that informal personal contact is a 
vital part of the influence and adoption process; {k) that group membevr- 
ship and reference group identifications are major predictors of individual 
adoption; (5) that the rate of diffusion through a social system follows 
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a predictable S-curve patter>: (very slow beginning followed by a 
period of very rapid diffusion, followed in turn by a long late 
adopter or 'Maggard'' period).- 

Figure 7*2 is drawn to illustrate some of these points. 



FIGURE 7.2 The Social Interaction Perspective 
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Major contributors to the 5-1 research tradition have been 
Coleman, Katz and Menzel (1966), Ryan and Gross (I9A3), Lionberger 
(i960), E. Rogers (1962, 1970), and Mort (196^), 

3. Problem Solving (P-S) * 

This model rests on the primary assumption that innovation is 
a part of a problem solving process which goes on inside the user. 
Problem sofving is usually seen as a patterned sequence of activities 
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beginning with a need^ sensed and articulated by the client, which 
is translated into a pt\^hltn statement and diagnci^ls. When he has 
thus formulated a problem statement, the client-user is able to con- 
duct a meaningful seorc?? and retrieval of ideas and information which 
can be used in formulating or selecting the innovation. Finally, 
the user needs to concern himself with adapting the innovation, trying 
out and evaluating its effectiveness in satisfying his original need. 

FIGURE 7<3 The Problem Solver Strategic Orientation ' 




The focus of this orientation is the user, himself j hif needs and 
what he does about satisfying his needs. The role of outsider 
is therefore consultative or collaborative. The outside change 
agent^may assist the user either by providing new ideas and innova- 
tions specific to th$ diagnosis or by providing guidance on the 
process of p.oblem solving at any or all of the indicated stages 
(as suggested by dotted arrows of Figure 7-3) » 

At least five points are generally stressed by advocates olF 
this orientation: first, that user need is the paramount cons i dera- 
tion and the only acceptable value-stance for the change agent; 
secondj that diagnosis of need always has to be an integral part of 
the total process; third, that the outside change agent should be 
nondirectivej rarely, if ever, violating the integrity of the user 
by placing himself In a directive or expert status; fourth^tKat the 
internal resourCfes, i.e., those resources already existing and easily 
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accessible within the client system, itself, should always be fully 
utilized; and fifth^that self -initiated and ^self-applied innovation 
will have the strongest user commitme^nt and the best chances for 
long- te''m surv i va 1 . 

A few of the major advocates of thi sj^ri entation are Lippitt, et ' 
\ al. (1958), Watson (1967). Jung (1970), G/^aplan (1963), and C. Rogers 

(1951, 1967). Most of those who belong to this school are social 
psychologists in the .group dynamics-human relations tradition. 

How Perspectives Can Influence D&U Agency Strategy 

These three perspectives were very useful to us in constructing the 
model of analysis used in this project to compare functions in the four 
agencies (see again Chapters 3 and h) because each focuses on a particular 
segment of the macrosystem. Figure 7-^ is drawn to suggest the overlapping 
sectors of concern and emphasis represented by each. 



FIGURE 7.^ Macrosystem Emphases of Three Change Perspectives 




One could Imagine three very contrasting types of D&U agencies based 
on these three perspectives. An RD&D-orlented agency would stress research 
quality, validity, and reliability; it would probably hav<e a few large 
projects that were very carefully planned and executed through competitive 
contracts to meet very specific development objec^^lves determined by policy^ 
•makers from quantitative needs assessment. There would be much emphasis 
on both screening and packaging for specified users* 
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An S-l oriented agency would be concerned more with transmission than 
transformation; it would have its own newsletters^, journals, and monographs, 
but it woiild also seek continuously to place stories and articles based on 
R&D in various professional and private-sector media deemed to be influential 
with various identified target populations Further it would continuously 
seek out key persons . among practitioner groups and researchers, attempting 
to involve them in dissemination efforts th rough . confe rences , consultations, 
and grants; it would also make sure that its own staff members regularly 
attended professional meetings, delivering papers and appearing on panels side- 
by-side with the researchers. An S-l-oriented D&U agency would also be likely 
to develop a special cadre of field agents who would "ride circuit" to opinion 
leaders in various parts of the country. 

Finally, a P-S-oriented D&U agency would focus its efforts on consultation 
with practitioners and subsidies to user organizations for self improvement 
and innovation; grants and contracts with the R&D 'commun i ty would emphasize 
joint definition of project objectives by practitioners and major participation 
by affected parties in project planning and decision mak^l\ng. There would be 
little emphasis on past research or on disseminating or getting use of 
particular R&D products. 

Measuring D&U Ideology 

Subsequent to the 1 i terature review and formulation of these three 
ideological clusters, we developed a series of statements about various 
aspects of D&U which could be used as a rating scale to measure attitudes of 
persons in various roles toward D&U issues. Items on the list were derived 
from the main tenets of these three orientations. The list was first used 
as a rating scale by a group of 50 na t i ona 1 1 y- recogn i zed experts on change 
process; at Clinton, Michigan in May of 1970. Whi le al 1 items were generally 
endorsed by most, of these participants, we d i s covered that there was a clear 
division and clustering cf opinion regarding emphasis which corresponded 
closely to our prediction of three perspectives (Havelock and Havelock, 1973, 
Chapter 1 ) . ^ . 

n 

In 1971,3 rejfised list of abbreviated items was presented to a National 
sample of 353 school superintendents as part of a mailed survey on innovation 
process. 'Results of this study confirmed our expectations in two important 
ways. First of all, the list was strongly endorsed as a good and complete 
summary of important procedural issues in innovation and'a'good checklist for 
innovation managers. Secondly, we found that i tems "cl ustered in a manner 
very similar to the three "perspectives" hypothesized eai^lier. In other 
worlds there appeared to be three ideological "types" among super i ntendents . 
The most common type was the "problem solvers" followed by the "RD&D's" and 
then the "social i n terac t ion i s ts"^ (although in that specific 'context we preferred 
to designate this last group as the "strategic manipulators") (Havelock, et al., 
1973) . . ' . 

..This chain of findings led us to believe that similar set r)f items 
would be useful in drawing comparisons among our four federril DCrU unit*, 
and' thel r respective user-^ "networks ." HeVice , a third vt^rsion (j\ (UncV- 
list was developed for inclusion both in the f ede ra 1/ i n 1 f*rv I ew> «ind in lUr 

two network surveys. / 

/ 
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B. METHODOLOGY 



In developing and administering this 20 item checklist we had four 
principal- purposes in mind; (1) first, to find if the configuration of 
ideologies emerging from previous studies held true for federal D&U personnel; 
(2) second, to discover new patterns or additional patterns of attitude or 
ideology, if any; (3) third, to search for possible biases or blind spots 
in the perceptions and attitudes of both agency staffs and their respective 
network contacts; and {k) finally^ to determine if ideologies conformed to 
program emphases as reflected in our analysis of DsU functions for the four 
agencies- (Chapter 4). 

" '■ / ' 

It must be admitted that some difficulties emerged in administration 
of the form itself which have weakened our data base somewhat. First of 
all, officials at the highest levels among those sampled tended to reject 
the form; hence we do not have complete data corresponding to our interviews. 
Secondly, there was resistance in all four agencies' to rating the actual 
performance of the DSL) unit on any of the 20 items; thus most of our analysis 
of this data is limited to respondents' judgments of the importance of the 
items general. We did not have the same problem in the network surveys, 
however, and will thus be able to provide side-by-side comparisons of 
"importance" and "performance" for both the SRS^and MA network surveys. 

' There is nc one "r ight^— way- to select i terns- ^o-r^-a -qjjest i-onna i re or to 
group items for analysis and summarization. Thus far we have discussed the 
concepts from which the 20 items were derived in terms of a theoretical model 
derived from literature review and supported by some previous investigations. 
However, it is also possible to cluster these items empirically, using pre- 
determined objective criteria without regard to theory. The most commonly 
used statistical procedures to achieve clustering fall under the heading of 
"factor ana lys is." ' ; 

Factor analysis has two principal purposes, both of which ^re germane 
to thi-'s survey projects The fjrst and most common purpose is data reduction^ 
i.e., the simplification of data presentation by reducing a large and complex 
set of item respohses> to a few key ^d inoens ions . A principal com- 

ponents factor analysis does this job by transforming a matrix of cdrrelations 
among all items. so as to produce new artifici^al variables which represent 
the most highly i n tercor rel ate'd sets of items. Each of these artificial 
variables or "factors" has two stat is t i cal proper t i es vh i ch are important in 
data reduction. First, each factor is "orthogonal" to every other factor; 
^'hence they are uncorrelated and should therefore have distinct and 'non-over- 
lapping meaning.; this conceptual purity of orthogonality is offset by the 
problem of interpretation; If a number of items of seemingly diverse content are re 
presented in one common "factor ," this factor will be very hard either to label or' 
to comprehend as a unitary phenomenon. The other statistical property cF principal 
component factors is the maximization of variance accounted for by successive 
factors: the first factor represents the linear combination of variables which 
represents the most variance; the second factor represents the linear com- 
bination of variables wf;iich represents the most variance after all- the variance 



*ln particular, -many agency respondents who did not workjn the D&U unit itself 

cl a i med they were 'not sufficiently familiar'^with their unit's work to be able 
^ o evaluate its performance on these dimensions. 



accounted for by the first factor is extracted from the correlation matrix; 
the third factor represents the next most variance and so forth. This fact 
Is very important for data reduction since i t means that an iny^stlgator can 
report as few or as many factors as he wishes with the assurance that the 
factors chosen represen t . t he maximum explanatory power using that number of 
concepts. 

On the other hand, a corresponding negative feature of the principle 
components solution is the tendency for too many items to pile up on the 
first factor. Because of the consequent difficulty of labelling and inter- 
preting such large "G" (general) factors, most investigators rotate the 
factor matrix to find more easily i nterpretab 1 e dimensions, to spread 
the variance more evenly among factors, or to achieve what is ofte\n 
called "simple structure." For this analysis we have chosen the "varimax" 
method developed by Kaiser (1958). ^s summarized by Nunnally (I967), this 
method "maximizes the sum of variances of squared loadings in the columns of 
the factor matrix. In each columri of the matrix, this tends to produce some 
high loadings and some loadings near zero, which is one aspect of simple 
s t ructure. . . The varimax method has proved very successful as an analytic 
approach? to obtaining orthogonal rotation* of factors. " 

Itjis'also possible to use factor analysis to test previously derived 
theories about the unoerlying structure of a set of items. .Part of our 
intenti6n in this project was to test the generalizations from our litera~ 
ture review against a freshly drawn $et of data. Therefore, as we consider 
the results from the varimax factor matrix, we w i 1 1 . be- refer r ing back, when 
possible, to the fit or similarity between these clusters ana the theoretica/1 
clusters reported earlier in this chapter. 

/ 

T^e questionnaire form on which the' Analysis is based is reproduced /as 
Table 7-1- can be see that ratings of '"importance" were asked for in five 
categories f rom ."essent i a 1 ," scored as "5," to "not Important at all," scored 
as "1." Means and standard deviat ions' were, computed for each sample on the 
basis p.f the federal responses from the fojr agencie?; a product-momen/t corre- 
lation j mat r ix then was constructed, factor analyzed by the principal component 
methodj and rotated by the varimax me^thod to a four factor solution which in 
• I - . 

•[Insert Tattle 7-1 here] - 

our op nion represents the most economical and adequate "simple st/fucture" 
clusteHng of the 20 items. . ' 

C. REfeULTS OF JHE FACTOR ANALYSIS 



/ 



Thi2 results of the factor analysis are presented in Table 7.2. . Factor 
"loadings" in this table represent correl at i ons between each i^em and each 
of the 'factors" derived. Hence, a factor is literaljy defined by those 
ite^ms which are correlated most highly with it and thus have ihe highest 
loadings. Items which have high loadings 6n one factor and jibw loadings 
on all other factors provide the most unambiguous def i n i t.i or/s . 

Ani exam i r^a t ion of Table 7-2 reveals four rather clearVfactprs . The 
largest'! and most complex seems to combine two notions, one concern i ng in- 
formal contacts between ushers and outs i'de resource groups/ and the other 



TABLE 7. 1 



Rating Form on D&U Strategy and Ideology Used in All Samples 



10. 



and 



Dissemination-Utilization Process and Proced ur 

The statements below are derived from research 
literature on dissemination and utilization (DSU) 
We would like you to rate the importance of each of 
these statements for the improvement of tbt D&V pro- 
cess generally. Having rated the importance of each 
item, we then would like you to con' ider how well 
such processes are presently handled in the area of 
human .or social need which is mo: t relevant to your 
wo r k . i 

■ r 



II 



I n you r op i n- 
'on , how im- 
portant is 
each' of the 
fol 1 ow i ng for 
the improve- 
ment of the 
D&U process 
general ly? 



Tb what extent 
ire these pre- 
^sent ly exempl i- 
f ied in 'the 
D&U a^ct 1 vi t i es 
in the area of/ 
human or social 
nefed wh i ch is 
i^inost relevant 
to your work? 



1. Collaboration and cooperation between researchers and 
users to find and adapt what is useful. 

2. Preceding utilization efforts by a ful I cycle of re- 7 
search, development, and eva) uat i on . 



3* Systematic planning of u.tilizatfon activities. 



i4. Selecting a competent sta'f to impjement chance. 



5'. Starting out with ad^uate financial resources to do 

the job. 

6. Stressing self-help by those who are goi ng to be the 



users of the research or change' contempl ated . 
Adequate diagnosis of the real user need 



/ 



8. Involvement of informal leaders of 



op » nj^on . 



9. informal personal cora»tacts with those who need to accept 



the change. 



Recip^rocai -feed-back by both us.ers and researchers. 



11. Adequate contacts by user with resource g roups outs, i de 
his own organization and re f e r e n c e grou p . 

12. Communication between levels in use" organ i zat ions . 

13. Making sure users are clear about thr pi -pose of the 
rese a rch and the ways i t might be us ] . 

Tk. Careful organ i zat ion of .the planning an > i mp 1 enien t^tTon 
efforts. 



15' Encouraging resource groups tu help use rs . re v i se , 

adapt or dr-VHv ripprop^r i ri to imp I i cat ions \ r/o\r\ research 
-J" 1 nd i nqs . 

16. Cioncrati ncj .j wi I 1 i r44^nt.">'. of user s to change thei r 

beii.) v i D^r r>r_ \J '> I <.>n l.n new- i ^Jn.v. . / 
J 7. (jenergtiru] ,\ fcfilinr) by users (h,it Yhc r u'sc'irrTh^Ti n(Y\ 'n<\\ 

wou 1 d h «i ve h i f)h UTu-fii f oir_ th<Mii j n tho i r work. 
TS~. ^U'nimi/i n(| frust r.jtio'n .ihcl di f f icVlly erKtrurTrdTeTd'ljV 

users try inrj in adopt pr adapt research finding s. 
19- Coordination and teamwork within the user system. 
ERXC ^^^^^^^^^^ campaign to put the regarch impl i cat 




I 




emphasizing user involvement and concern for user needs. Of the two the 
informal contact dimension seems clearer on the criterion of simple struc- 
ture (low loadings on other factors) but the two ideas are very definitely 
part~jof the same factor. Hence the factor combines the concepts of 
"problem-solving" and "social interaction." 



TASLE 7.2 



A Factor Analysis of D&U Strategy Items- 
(Four Factor Sol ut ion-Var imax Rotation) 



Item Clusters (Question Numbers from Table 7-1 in parenthesis) 



Loadings on Each Factor 
1' 11 111 IV 



Factor I: Building an Informal Network which is User-Centered ' 



Generate user feeling of research benefit (17) 


.67 


.09 


.23 


-.21 


Stress self help by users(6) 


.60 


.28 


.17 


-.05 


H i n i mi ze use r f rus t ra t i on ( 1 8) 


.56 


-.23 


.26 


• 29 


Encourage resource groups to help users (15) 


M 


-.37 


.26 


-.26 


Diagnosis of real user need(7) 


M 


-.08 


.37 


.21 


Informal opinion leaders (8) 


.76 


. 10 


-.15 


.03 


User contacts with outside resources (11) 


.68 


-.33 


.07 


-.02 


Informal personal contact (9) 


.58 


. 12 


-.07 


-.19 



Factor II: Generating User Capacity 



Factor III: Emphasizing Systematic Res., Dev., and Dissem . 

Concerted campaign (20) 

Make users clear on purpose (13) 

Full RD&E cycle (2) 

Careful organization (l^) 

Sy s tema tic planning (3) 

Factor IV: Linkage (2-way Communication) 

Res. -user collaboration (l) 
Res. -user reciprocal feedback (10) 
Coordination within user (19) 
Communication between user levels (12) 



Financial resources (5) 


- .02 


.78 


.05 


-.09 


Generate user willingness; (I6) 


-.12 


.73 


.07 


.Ik 


Competent staff {k) 


.35 


.73 


.09 


. 10 



. 1i» 


.32 


.73 




.05 


-.09 


-.36 


.63 


.Ik 


.Oi» 


.k] 


.60 


.07 


.2'> 


-.26 


.58 


.08 


.Ok 


. 16 


.k8 


-.19 


-.12 


-.05 


.03 


.83 


-.21 


.08 


.23 


.75 


.15 


.37 - 


-.26 


.63 


.^♦3 


.13 - 


-.39 


.kS 



*Based on responses of 52 raters in four federal agencies. 

**These labels are our Interpretation of the conceptual dimension represented 
the loadings of the items. 

ERIC 
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The second factor is clearly marked by three items with high loadings. 
The purest of these concerns f i nanc i a 1 resources but all three imply various 
aspects of user capacity, i.e,, finances, motivation, and competence. This 
factor is not clearly identified with any of the three theoretical clusters 
hypothesized. 

The third factor, composed of five high loading items, is very clearly 
associated with the predicted "RD&D'* perspective, emphasizing planning, 
research, development, evaluation, and a planned dissemination thrust. 
However, some items in this cluster are also fairly strongly related to 
other factor*; as well. Notably, items #2 and #20 {"full cycle" and "campaign") 
imply extensive use of resources and hence a high sy s tem -'capac i ty . I terns 
#13 and #n, on the other hand, focus on care and caution with the implication 
that both R&D and. user* sys tem capacity should not be over-rated. Thus, there 
is an ambivalent rel at lonsh i p "between the RsO Factor l\\ and the Capacity 
Factor II. 

Finally, a fourth factor is clearly marked by item #1 which was directly 
derived from the "linkage" perspective proposed by Havelock, et al^ (1969), 
All items in this cluster incorporate the jdea of two-way communication 
among the various human elements In the D&U macrosystem. However, item #12 
which refers to intra-user system linkage Is also quite strongly related 
to the user-centered information network approach of Factor I. 

In summary, we find moderate confirmation of predicted clusters and 
more importantly a set of dimensions which hold together logically as well 
as statistically. For these reasons we have chosen these factors as the 
basis of our further presentation of data on Inter-agency differences. How- 
ever, we will make one modification; for the sake of conceptual clarity, 
Factor I items will be divided into two clusters, one representing the focus 
on the user (and hence most closely associated with the "Problem Solver" 
perspect \ ve), the other representing the focus on the communication network 
(and hence most closely associated with the "Social Interaction" perspective). 

D. INTER-AGENCY Dl FFERENCES 

Understanding the meaning of 20 items for four agencies, two surveys 
and two types of questions is a formidable task for the researcher, let 
alone the reader. Thus, we have attempted to break down and summarize 
the data in several different ways to elucidate different points. Table 7-3, 
for example, shows agency comparisons in a rather crude form. It was con- 
structed by taking the raw mean response of each set of respondents to each 
item and deriving a mean of means for each dimension identified in the 
factor analysis. 

[Insert Table 7-3 here] 

A few points are made quite clear by this table. First of all, on the 
average a U d 1 mens i ons are considered at least moderately important by 
representatives r3l 1 four agencies . Secondly,r there are quite distinct 
preferences among the dimensions, "linkage" being most popular (highest with 
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TABLE 7.3 



Mean Agency Responses" to Each Strategy Dimension 



a of I terns Di mens i on 



Federal Agency Respondents (in Phase I of the Project) 
NIHH (n=10) OE (n=l6) SRS (n=12) MA (n=l^) ' 



3 
3 
5 



Us e r-cen ter i ng 
(Factor l-A) 

Network bu i 1 d i ng 
(Factor l-B) 

Capac I ty 
(Factor I I ) 

RD&D 
(Factor ill) 

L i nkage 
(Factor IV) 



3.28 
3.17 

3.60 



3.90 
3.77 
k. 10 
3.98 
3.93 



3.6/4 
3.20 
3.83 
3. 98 
3.95 



^♦.03 
3.70 
i*.08 



*5 = "essential"; 1 = "not important at all" 




MA and NiMH) followed closely by "capacity" (highest with OE, second highest 
with NIMH and MA) and "RD&D" (highest with SRS, next highest with OE) . Agree- 
ment among agencies is even more striking at the bottom of the popularity scale. 
"Network building" was least popular with all, "user-centering" next least. 

A third important revelation from Table 7.3 are the very striking 
inter-agency differences in over-all response. NIMH respondents tended to 
rate al 1 i tems lower , and, in fact, had the bottom score for 17 out of the 
total set of 20 items.*- We are not sure what this trend signifies; one 
interpretation may be that NIMH, being less involved in directed, mission 
oriented research, has less concern for planned strategies of DsU of any 
kind. 
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At the other extreme, OE places the highest emphasis on four of the five 
dimensions. This may reflect a greater investment in D&U over several 

years and a larger nucleus of persons for whom these concerns are central. 
It is noteworthy, however, that on the "linkage" dimension the Manpower 
respondents have the highest ratings. Indeed, this seems to reflect the great 
emphasis placed on linkage through such functional mechanisms as the "buddy 



system" and "interchange " 



'^'^For 9 of these I? the difference was statistically significant by analysis 

of variance at a probability level of .10 or smaller despite the very small 
numbers involved. 
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Because the inter-agency differences in over-all response were large, 
we felt that detailed comparison of absolute ratings would be somewhat 
confusing. Therefore, a rank score was derived for e'^ach item which repre- 
sents its relative ranking out of 20 for that agency alone. In Table J.k 
through 7'8, the detailed item-by-item analysis will be presented in this 
intra-agency ranked form. 



TABLE 7.^ User Centering Dimension 



(Relative Ranking Out of 20 Items within Each 

Set of Respondents) 

Item , NIMH OE SRS MA 



Generate user feeling of 
research benefit 


10. 


■ 5 


]k 


12. 


■ S 


" 11.5 


Stress self help by users 


18. 


5 


20 


20 




20 


Minimize user frustration 


16. 


.5 


7 


16 




15 


Encourage researchers to help 


users 9 




\k 


8. 


S 


15 


Diagnosis of real user need 


3 




1 


1 . 


5 


5 



Mean Ranks 11.5 11.2 10.5 13-3 



Table 7-^ indicates that while this dimension may rank low over-all in 
the es t imat i on of our respondents, at least one i tern wi th i n"- i t ranks high; 
"adequate diagnosis of the real user need" is highest rated .by OE respondents 
and tied for highest at SRS. What remains ambiguous in the item is "who does 
the' d i agnos i s7" For some this will be an act in which the user is intimately 
involved, for others it may be a question for experts and for careful research 
investigation. Both ideas draw a response to this item as indicated by the 
loadings on Table 7.2. 

"Stressing self help" was the least popular strategy for three of the 
four agencies. Evidently this item suggests too passive a stance for the D&U 
system although it roughly echoes a major point in the second Nixon inaugural 
and has been generally emphasized as a matter of ac^'^in istrat ion policy. 

Lastly, when we examine the mean ranks, we find little difference among 
the four agencies with the MA ratings being perhaps somewhat lower. 

[Insert Table 7-5 here] 

In Table 7-5 what is most noteworthy is the very low rating of "involve- 
ment of opinion leaders" as an element of strategy. Such views seem to 
0 .indicate either ignorance or rejection of a very large bulk of findings on 
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TABLE 7.5 



Network BuMdlng^ Dimension 



(Relative Ranking Out of 20 I terns within Each 
Set of Respondents) 



1 tem 


NIMH 


OE 




SRS 


m 


Informal opinion leaders 


18.5 


17. 


5 


19 


19 


User contacts with outside resources 




10 




18 


15 


Informal personal contact 




14 




17 


10 


Mean Ranl<s 


12.5 


13. 


,8 


18 


K^.7 



the diffusion of innovations which point to the absolutely crucial role of 
the opinion leader. What may account for this rating, however, is the puzzle- 
ment of many D&U managers on how to use such findings in a practical way. 
This attitude and the reasons behind it deserve further investigation; it 



would be ironic, indeed, if" those responsible for D&U turned their backs on 
the most solid empirical research on their own subject. 




Mean rankings on the '^Network Building'* dimension are low for all four 
agencies but extremely low for SRS and quite low for MA, the two agencies 
where we would judge the i nformaj . profess iona 1 networks to be weakest and 
most diffuse. For NiMH, on the other hand, where the informal professional 
networks are very strong and buttressed by strong professional associations! 
the relative rankings are highest for this dimension. Primarily this is 
caused by tKe high NIMH rating of "informal perrona.1 contacts"; in this 
respect it was noted that NIMH staff in the branch under study did far more 
field visiting than their counterparts in the other three agencies* 



TABLE 7.6 Capacity Dimension 

(Relative Ranking Out^of 20 I terns within Each 



ErJc -286- 



1 tem 


NIMH ■ 


OE 


SRS 


MA 




Financial resources 


16.5 


\k 


12.5 


8 




Generate user willingness 


7 


5 


6.5 


8 




Competent staff 


7 


3.5 


10.5 


5 





Mean Ranks 10.2 7-5 9-8 



From Table 7-6 we can see that financial resources are not the most 
important aspect of ''capacity" as far as most respondents are concerned. 
Particularly for NIMH and OE (with the most affluent RSD programs), motiva- 
vatfon and competence are much more important. For MA, all the capacity 
items are quite important. 



TABLE 7.7 RD&D Focus Dimension 



(Relative Ranking Out of 20 Items within Each 
Set of Respondents) 



1 tern 


NIMH 


OE 


SRS 


MA 




Concerted campaign 




19 


10.5 


11.5 




Make users clear on purpose 


2 


14 


5 


15 




Ful 1 RD&E cycle 


20 


10 


]k 


18 




•Careful organization 


7 


3.5 


3.5 


5 




Systematic planning 


10.5 


2 


'3.5 


3 





Mean Ranks 10.8 9-7 7-3 10,5 



Three of the four agencies differ little pn the RD&O Focus dimension 
(Table 7.7). SRS, rates highest, no doubt reflecting the extreme emphasis on 
tightening management practices and increasing R&D accountability which was 
very evident at the time of our interviews. On certain items, however, inter- 
agency differences are marked. The '^full cycle" notion is least popular in 
NIMH and in MA, and, indeed such a full cycle is difficult to discern in 
many of their program thrusts. NIMH is also relatively low on "systematic 
plaonlng" again reflecting the small amount of administrative pressure in 
this direction. On the other hand, great importance is placed on clarifying 
research purpose and possible uses in NIMH and SRS. Possibly this may re- 
flect the greater risk of certain kinds of misuses in medically related 
disciplines. 

[Insert Table 7-8 here] 

Table 7.8 delineates the s'eparate agency responses on the Linkage 
dimension, and here it is also clear that some items are far more popular 
than others. The strongest item for NIMH, MA, and SRS (tied) is "collaboration 
and cooperation betv;een researchers and users..". It should be remembered 
from Table 7.2 that this is also the highest loaded and "purest" of the four 
items in this cluster. Absolute ratings on this item are between "very 
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TABLE 7.8 Linkage Dimension 

(Re*lative Ranking Out of 20 Items within Each 
Set of Respondents) 



1 tern 


NiMH 


OE 


SRi. 


MA 




Res earcher-user col 1 e^'orat ion 


1 


7 


1.5 ,■ 


1 




Res earcher- user reciprocal feedback 




7 


8.5 


2 




Coord i net ion- w i th i n user 


12 


17.5 


6.5 


•15 




Communication between user levels 


13 


10 


15 


8 





Mean Ranks 7-6 10.^ • 7-9 6.5 



important" and "essential" for all agency samples including OE. However, 
its lower rel at i ve ranking in OE may be related to the vastness cf that D&U 
system and hence the greater difficulty of providing one-to-one services. 

It is also generally true that linkages between researchers and users 
(the first two items) are rated as more important than linkages within the 



user system. Tiiis, 


of course, is a federal 


V iewpo int. 






TABLE 7.9 


Mean of Mean Ranks 


for Five Dimensions 






NIMH 


OE 


SRS 


MA 


User Centering 


11.5 


11.2 


10.5 


13.3 


Network Building 


12.5 


13.8 


18 


1^.7 


Capacity 


10.2 


7.5 


9.8 


7 


RD&D 


10.8 


5-7 


7-3 


10.5 


L i nkage 


7.6 


10.^ 


7.9 


6.5 
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Relative mean ranks are again summar i^zed i p Table 7. 9^ In the main, 
officials in different agencies seem to view DsU in very similar ways. 
Linkage is most important, perhaps, for the Manpower DSU unit and thi^ is 
certainly reflected in our interviews and in the philosophy expressed by 
its OSU chief,, but it is also very important in relative and absolute terms . 
for NIMH and SRS. Network building, on the other hand, which many might 
logically be considered related to linkage building, is very low rated by all 
four agencies on a relative scale. 

E. FEDERAL STAFF AND USER NETWORK IDEOLOGIES COMPARED 

Figure'7-5 compares responses on ''importance" of the^ZO strategy state- 
ments from each o^^ the user networks with responses from Federal agency^yX 
employee's. We combined all d^ta from Phase I interviews with responses from 

[Insert Table 7-5 here] 

Federal employees in the network pilot studies'^ to give us aJTederal" group 

for each agency, fcv^assess di f ferent. perspecti ves between the agency and 

the "outside," we then created a group composed of all the non-Federal employees 

from the pilot studies. The 20 I tern means for the groups are found in 

Figure 7.5. * " ' ' 

The first thing we note in scanning the means is the high overall agree- 
ment in the profiles of the means ''or Federal and non-Federal respondents tn 
each of these social problem areas. Ranking the 20 means, we find Spearman 
rank order correlations of .91 for the two Manpower groups, and .87 for the 
SRS groups (significant well beyond the .01 level). If we compare all Manpower 
to all SRS means, the correlation is .88. So, there appears to be an extra- 
ordinary universality and stability of opinions concerning D&V within each 
system^ and across systems. We would also therefore expect to find a very 
similar underlying structure of ideologies in the dif ferent sampljes . 

An important difference, difficult to 'perceive In the figure, is the 
overall difference between the two agencies. On 18 of the 20 i ten)s SRS has 
a slightly higher score than Manpower (significant by sign test, p<.00l). 
Manpower as a whole scored higher only on "Communication between levels rn 
user organization/' and "Selecting a competent staff to implemen't change*" 
Hence, it can fairly be sai.d that the SRS system perceives effort on all these 
dimension^ of DsU as being somewhat more important than their Manpower counter- 
parts. The differences do become more specific when we compare Federal and 
non-Federal groups across the agencies. 1 f we compare the Manpower and SRS 
Federal groups, we find no difference hn the mean levels (MA is hf^her than 
SRS on eight; MA is lower on 12). When we compare the two non-Federal networks, 
however, the differences are striking": SRS respondents are higher on eveiry one 
of the 20 items. The two agencies also differ internally: in Manpower, the 
Federal employees are higher than their network on 15 of the items; but in 
SRS, the network is higher than the Federal employees on 16 items. In summary, 
then, the differences between the two agencies come not from the Federal 
employees , but from the fact that the SRS network rates all of the items much 
higher than does the Manpower network. 

*The methodology of these surveys was presented in Chapter Five. 
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flGURE 7.5 



Federal and User Network D&U I deo^ogy Compared 
, . ' - * . ■ MANPOWER 



Maati : 



SRS 



^ 5 



OiMENSI ONS/P^ocedur t•^ 

^Gene 'rating a feeling b'y users that research findings would 
have high benefit tor them in their work 

Stre-jsincj self-help by thase who are going to be tjie users 
f fnc resf.irVh nr chjnge contemplated 

I 

Min.mi/ir>q fru^trviion and difficulty encountered by users 
trvinq to .iJoDt c« r adapt research findings 

Encoifr.ig i r.»j ro^.njrcc qroui}^^ to lie]p ui>ers revise, adapt' or 
Jfcuv c-uip r' t I 1 1 1' t 'lip ] i c J t i on V 



idequdte diagnosis i,f jhe re'al user need 



j I n j^o I vemeq t of informal leaders of opinion 

^'j^deijuate contacts by user with resource groups outside nis 
oCo/n organization and reference group 

Informal, personal contacts with those who need to accept 
the change 




irrii:ing out wit*i adequate financiaf resources -to do the 



■ enerating a willingness of user'j to change their behavior 
) r ! i > t en [o new i deas 



Selecting j competent staff lo implement change 



A Concerted campaign to put tt?p reseorch impMcations across 

laiv 1 ng sure users are clear abou[ the'"^rpose of the research 
•ind ♦vays it (lighr be used 

Preceoing utiii/atinr^ efforts by a full cycle of research, 
development, and evaluatton ' 

Careful organization of the planning and implementation 
effort 



Systematic planning of utMi/ation activities 



Collaboration and cooperation between ri>searchers and users 
to find and adapt what is useful 

Recfprocal feedback by both users and researchers 
Coordination and tearm^jork within the' user system 
Ccmmuni cat * on between levels In user organizations 



ERIC 











— So) id- lines = Federal • on ly Importance 
l. — — —. Dotted lines = User Network Importance 



-290- 



[Insert Figure 7.6 here] 
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The largest discrepancies .in perception of^ important s t rateg i es occur in 
different places in the two systems, however, though both occur in' the "area" 
we have called "user centering." For SRS there is a significant dif-ference ' 
(by t^ test) between the Federal and non-Federal groups on "Stress i^ng self-help 
by those who are going to be the users...," with the network saying this is 
of higher importance. In Manpower, the difference between the ^two groups is 
on "Adequate diagnosis of the real user need," with the ne two rl^ lower. Thus, 
the SRS Federal staff may be under-concerned with development of own self-help 
capabilities among their users, and the Manpower network under-concerned with 
the importance of user need diagnosis. 

F. IMPORTANCE AND EXISTING REALITIES COMPARED (SRS ancl MA User Networks) 

Figure 7-6 displays comparative data for each network survey on ratings 
of ^''importance" of each of the 20 Strategy items and ratings of "To what 
extent are these presently exemplified in the D5U activities in the area 
of human or social need which is most relevant to your work?" (See again 
Table 7«1 for the layout of the question in the survey instrument.) ^ 

Very clearly there are Large discrepancies between "importance" ratings 
and "presently exemp 1 i f i e'd^' ratings for al 1 i terns, in both networks, indicating 
a tremendous performance gap for all aspects of D'SU. Less evident in t+ie 
figure is the fact that once again the rank order of items on "presently 
exempl 1 f ied" "between the two agency petworks is fairly highly correlated 
(Spearman r = .75,><-01), this despite the fact that the range of responses 
is quite narrow for both samples.. The ratings for the two networksvon 
"presentl7 exempl i f i ed" ^'re very similar both in pattern and absolute values, 
although because of the higher bver-all "importance" ratings in SRS, discre- 
pancy scores are also significally higher for the SRS network than for the MA 
network (si.gri test p^.01). 

Because .the pattern of discrepancies on some dimensions seemed to have ' '^''^ 
almost a mTrror image, we also computed rank order correlations for "importance" 
vs. "presently exemplified" for each network. The resuiTs showed minimal 
relationships (SRS r=-.13, MAr=+.l8). 

0n individual items, the largest discrepancies for both samples were on 
"Adequate diagnosis of the real user need" (last item on Lfeer-Cente r i ng 
dimension) and "collaboration and cooperation between researchers and users' 
to find and adapt what is useful" (fi rst item on Linkage dimension). However, 
there were several close runners-up (e„g., "reciprocal feedback," Linkage #2; 
"making sure users are clear on research purpose ,"iRD&D #2; "generating willing- 
ness," Capacity #2; "systematic planning," RD&O #5; and "minimizing user 
frustration," User-Centering #3)- Generally the largest discrepancies stretched 
across four of the five dimensions. 

Smallest discrepancies were on the two items also rated lowest In ^ 
importance: "stressing user self-help" ^nd "involvement o,f informal leaders of 
op^inion." The highest "presently exemplified" rating in both networks w^nt 
to "competent staff." In the MaTnpower network financial capacity was equal lyi 
highly rated. Neverthel ess there rema ins a wide gsp on both these capacity I 
items between existing reality and importance. V 
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FIGURE 76 



ideal and Actual D&U Performance Cdmpared <SRS and HA User Network Surv'eys ) ' 



MANPOWER 



Mean: 



SRS 



OIMENS lONS/Procedures 



Generating a fe,el ing by users that research findl/igs' • 
would have high' benefit, for Che'ni in: their work , 

Stressing self-help by those who are going to be the 
osprs of the research or change con t emp 1 a t e-d / 

/ M i n i mi / i nfj 1 r u"^ t r t t o n jnd difficulty encountered by 
^uscf^ trvir^c) to .Wi>p t or adiipt research findings * 

<> 

Encour.iq i nq rt*'>oii'Le groups to help users revise, adapt 
or drtjw .ii>p roi- r i .-^ U' implications 



Ajf.juate diagnosis uf the renl user need 



I n v<i I ^enit'n I of informal leaders of opinion 

Ade.ju.ue coniacti> by user with resource groups outside' 
\ h i s ''wn organization and reference group 
o \ * . ■' . • 

Informal personal contacts with those^who need to 
acceDt the change , 



■ 5< 



'^i tar t i ng. out with adequate financial resources to do 
the j ob 'i * ' 

Gener.>3ling a willingness of users to change their 
be^iavior or < is ten to new ideas • 

Selecting vi competent staff to implement change ^ « 




0- ^ 



\ c<^ncerted campaign j\o put the research Implications 



M.Aing sure users are clear about tfie^purpose of the 
research tind ways it might be used 

Prccedi ng ot i I i zat i on efforts by a f u 1 1 eye 1 e of 
rc'>earcti, dc vc I o^riicn I , and evaluation 

Careful organization of the iilanninq and implnmenta- 
tionefforts ' 



Systematic plann.ng of utiii/ation activities 



Collaboration and* coope rat ) on between researchers and 

users to find and adapl/vha^ js useful » 

Reciprocal feedback by both users and researchers < • 

Coordination and teamwork within the user system • • 

CofThun i^.ation between levels in user organizations ^ 



O } Solid lines = Presently Exemplified in^D/.U 

. Dotted lines = Important Jor Improving Df.U 
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CONCLUSIONS FROM STRATEGY- I DEOLOC' ANALYSIS 



In the preceding sections of this chapter, we have'offered many djs'tailed 
tables and analyses based on responses to 20. items. Are-there some general 
conclusions which can be derived from what we have presented? 

First of all, we think we haVe confirmed the existence of some distinct 
ideologies or strategic prefe/ences among those concerned with D&U. In general, 
however, no one ideology is dominant in any one of our agencies or among either 
of the us^r ^networks sampled. In fact the pattern of preferences among 
strategic alternatives is remarkably constant across groups. On the other 
hand, there are some significant differences between samples which cut 
across all items. Notably, the NIMH group rated nearly al 1 items as less 
^'important" than did their counterparts in the other three agencies. We 
also found that the user networks rated most items as more important than 
;did their federal counterparts, and finally that the SRS network rated most 
items more important than did the Manpower network. In all cases, however, 
the relative emphasis on different items was very similar. 

• • . ■ ■ I 

Much of our analysis can be summarized nost simply by findings on just 
three items from the ' 20 because these three items arje most repre^entat i ve" of 
the range of concerns and the ideological di tferenc/l' expressed. 'They are as 
f o 1 1 ows : " ^ ' 

■ 1. "Collaboration and cooperation between researchers and 
users to find 'and adapt what is useful." This item has 
the highest "importance" ranking in 3 ^ agencies and 
In both user networks . It is also the highest loading 
item on the "Linkage" dimension (Table 7.2) and shpws 
the highest and next-to-highest ideal-actual discre- 
pancies among the SRS and Manpower user networks 
respectively. * . - 

2. "Adequate diagnosis of the real user need" was rated^ 
very 'Close beh i nd ^ 'col labo ra t i on" for ^mos t sampl es and 
highest for USOE. It is a factorially complex item, , 
having its highest loading on the "User-Centering" 
d imens f on^ but also loading ratKer highly on the "RD&D" 
dimension. In terms of ideal-actual d i screpancieSj it 
showed the largest gap for both networks. 



3. "Careful organization of the planning and implementation 
.efforts" is probably the best item to select as a repre- 
! sentative of the "RDSD" dimension. It is third- ranked- 

in Importance by federal staff's in OE and SRS, fifth in 
MA, and seventhMn NIMH^ It also shows very high ideal- 
actual discrepancies in both user network surveys. 

As a set these items well ref)resent 'the D&U-related concerns and aspirations 
of all the groups sampled; they also appear to represent broad segments of 
the ideal model of DSU' offered in Chapter 3'and used as an analytic frame- 
..work in Chapter 4. Hence, we feel they offer a basic guideline or set of 
principles for any D&U unit. 

On the other hand, the set does net cover two of the dimensions which 
emerged from our analysis, namely "Capacity" and "Network Building." First, 
^ori capacity, we have not found'any dranr.,:tic evixjence of either overwhelming 
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importauce or crying need, although ideal-actual discrepancies are evident. 
Furthermore, "capac i ty, wh 1 1 e being a clear and independent dimension of 
moderate importance, is something that D&U strategists can usually do very 
little about . 

On "Network Building" we remain somewhat puzzled and frankly in disagree- 
ment with our respondent s, pa rt i cu 1 a rl y on the item 'Mnvolvement of informal 
leaders of opinion." Empirical research on change shows no strategic element more 
Important than this one, ^et It i s . uons i stent 1 y one of the least popular of our 
20 strategy items, ;among saci/of the groups in our various surveys. 

I I . H-E-L-P $-C'0-R-E-S:/a TEN PART RATING SCHEMA FOR DIAGNOSING D&U - ' 

PROBLEMS I 

A. BACKGROUND AND RATIONALE 

As a way of summarizing most of the empirical findings from the research 
literature on D&U, Havelock, et al. (1969) proposed seven "factors'* which 
seemed to run as consistent themes throughout hundreds of studies. The most 
Important of these was identified as "linkage'^ by which we meant primarily 
the existence of person-to-person contacts wh6xe two-way communication was 
taking "place. It Is evident from the foregoing section of this chapter 
that this aspect of DSU process is also deemed of greatest importance to a 
wide spectrum of D&U specialists, administrators, and users. The second 
factor, which we labelled "structuring," referred primarily to the orderliness 
with which D&U activities were conceived and executed. It is most closely 
related to the "RD&D" dimension discussed earlier;' 

A third factor, labelled "openness," was used to describe a motivational 
state either in researchers or users which predisposed them to both giving 
and receiving new information, giving and receiving information on new channels, 
or trying out new behaviors. 

ft - 
A fourth factor, identified as "capacity^" is closely related to the 

"Capacity"^ dimension emerging from our 20 item analysis. It included most 

of the things we usually think of as separating the "have's" and the "have-not's" 

money, resources, skill, intelligence, education. 

Dis't?nct from, and in some cases more manipulable than "capacity" is the 
"reward" factor. The concept of "reward" or "reinforcement" is 

fundamental in most theory and research on the psychology of 
learning; it seemed obvious that amount, type, and frequency of rewards 
were vitally important to. build and maintain habits of research dissemination 
and utilization. It was particularly clear that rewards for researchers in 
getting their research utilized by non- researchers were practically non- 
existent. Likewise, the reward-value of most research reports for most 
practitioners was. usually not-at-all clear. 

' ' A sixth factor, "proximity" was included to account for the many findings 
Xfrom the "socialjlnteract ion" researchers) which pointed to relative position 
in social networks as a key factor^n successful influence and diffusion. 
Physical proximit^y is also known to be very* predictive of the use of informa- 
tj.on systems and servicers. It is a ^usually necessary prerequisite to 
observability (demonstrations) and to interpersonal' commun icat ion- (l,in4cage). 

Finally, we invoked the concept of "synergy" to accQunt for certain 
important^ effects which seem to ocQur only when there Is a convergence of 
efforts and/or stimuli on potential users. A single message at one time and one 
place op one channel • seldom has much, impact by itse]f unless it -is very simple 
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and very similar to past messages received. Research utilization, on the 
other hand, usually involves a fairly complex message and sometimes a message 
which contradicts or runs in an entirely different direction from the past 
thinking of the would-be user. If this is the case, then transfer will not 
succeed unless and until the message is repeated in different forms, perhaps on 
different media, and most certainly until it is "confirmed" from more than 
one source. Planned formal DSU systems sometimes take inadequate account 
of this fact, whereas very active informal networks by their very nature in- 
corporate it. 

Subsequent to the publication of this seven factor analysis, Rogers and 
Shoemaker (1971) came forth with a revised edition of Rogers* earlier work on 
the Diffusion of Innovations . Their new edition included three concepts 
which we thought were inadequately covered in our list. The first of these 
was "homophily," defi ed by themas *'the degree to which pairs of individuals 1 
who interact are similar in certain attributes." Most studies of diffusion 
indicate th'at successful transfer most often occurs between homophilous pairs. 

Another concept which was not adequately covered in our earlier analysis 
is "empathy," i.e., the degree to which users and resource persons can accurately 
understand and appreciate each other's situation. "Empathy" may be a result 
of either linkage or homophily or both, but it is a distinct dimension and 
may occur independently of either. Rogers and Shoemaker cite a number of studies 
which indicate that earlier adopters have more empathetic ability, and they hypothe- 
size that successful change agents will also have more empathy with their clients. 
This concept is closely associated with the "user-centering" dimension discussed 
earlier. 

Finally, we found in Rogers and Shoemaker that change agent success in 
gaining adoption of innovations is closely associated with the amount of 
effort expended by the agent. They cite 16 empirical studies which support 
this hypothesis and only 3 which do not support it. We expect that this 
dimension is a general one, applying not only to change agents but to researchers, 
pract 1 1 ioner's, and other users as well. The word "energy" is used by us to de- 
fine this ccncept. 

* 

As a package of concepts to remember, these ten principles of effective 
utilization are a difficult set to keep in rr..,.d. It was for this reason only 
that we reordered them into the acronym "HELP SCORES." Fortunately we were 
able to sort them into two words which had some sense and relevance in them- 
selves. Indeed, as a guide for the D&U specialist in judging his own program 
or in planning, supporting, and evaluating specific D&U activities, we believe 
this list represents a rather comprehens i ve checkl i s t . 

To mak(5 a preliminary test of the adequacy of this list, we decided to code the 
responses to our in-depth interviews with personnel of the Manpower Administra- 
tion. The results of our analysis appear below. 

B. PROCESS-^AND PROBLEMS IN THE MANPOWER D&U SYSTEM REVEALED BY A H-E-L-P 
S-C-O-R-E-S ANALYSIS 

Following Is an analysis of the intervi ews conducted with 
the Division of R&D Utilization in the Manpower Administration, Department 
of Labor. There were 16 interviews conducted, six with staff members of the 
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R&D unit and ten with other persons identified by the unit as most relevant 
to their work; in our analysis the DSL) staff will often be designated as 
^'Insiders" and the others as "outsiders." All interviews were taped and 
subsequently transformed into detailed summaries. The two principal 
investigators then independently coded all contents using the guidelines 
shown in Tab le 7* 10. 

[insert Table 7- 10 here] 

Homophi^Jy 

Diffusion research studies consistently show that when senders and 
receivers are similar to one another in various relevant characteristics, 
communication is easier. The degree of similarity between sender and 
receiver has been :called "homophily." A D&U unit which stressed homophi )y 
in its strategy would do all that it could to use communicators of R&D 
who were similar to intended audiences in language, age, sex, profession, 
etc. It would also try to shape the message so that it would be in the 
user's language and presented in a manner that the user might have employed 
himself. Homophily also applies to less tangible characteristics such as 
values, belief systems, and culture. Generally speaking, research and 
practitioner communities are likely to differ widely on these dimensions, 
so that the D&U strategist may have a real task In finding crucial elements 
that they have in common. 

Although homophijy is an implicitly important aspect of many of the 
Division's activities, it received very little explicit mention in inter- 
view Four comments from three insiders were coded in this category com- 
pareo ^o three comments from three outsiders. 

One insider described the typical researchers as "too academic" in 
language style so that abstracts had to be written by Division staff (who 
presumably have a better feel for the style that a typical user would accept). 
Another insider agreed on the importance of form but added that the form 
and substance had to be consistent with the user's view of the world (belief 
system homophily). A third insider respondent indicated that the problem 
may be more functional In that users are not really that concerned with 
research. 

One outsider echoed this view while placing more emphas i s pn the 
researcher's orientation. Jniversity people, he said, were usually inclined 
only toward topics in which they had personal interest. Therefore, it is 
often hard to find a researcher interested rn a problem of concern to the 
department. Another respondent saw a difference between his division in 
USES and ORD on what constitutes "good" research, implying that ORD, itself, 
was too academic in its orientation.' But a more serious value discrepancy 
,was cited by another respondent as crucial i he said that the R&D work done 
by ORO contractors is "in opposition to concepts accepted by the American 
people." Hence, some policy people in high positions view them as "wild 
people." 
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TABLE 7.10 



Guidelines for Interview Coding on H-E-L-P S-C-Q-R-E-S 



HooKJVjhiJy ♦ Similarity of charac te r I s i cs of sender «nd receivers e.g., wHh respect to 

values, age, education, language, resources; congruence or aUkeness. 

- 0 i is imi 1 ar i t ies of sender and receiver, especially targe differences or 
discrepancies in any of the above. 



EKpathy ♦ Understanding or feeling for the other and the other's situation. Might be 

inferred from efforts to simulate or understand the role of the other, e.g., 
the client by the researcher, the researcher by the cHent, the client and 
the researcher's situation by the federal agency, etc. (Does not Imply any 
d t fee t cotTfTum i cat ion with the other,) 

- Failure to understand or feel for the other. 



Linkage + Contact or relationship between persons or groups is sought or achieved. 

- Contact between persons or groups Is notably absent, falls to be achieved, 

or i s broken . 



Proximity ♦ Placement of persons or groups near each other, juxtaposition, arranging so 

tha: people wi 1 1 be In the same place at the same time, but wi thout neces- 
sarily establishing corwnun i cat I on between them (which would be better scored 
as linkage); spatial or geographical arrangements which place users, resourcers, 
and federal personnel close to each other. Travelling and general visiting 
might be scored as "p rox Imf ty"-c reat log behavior rather than "linking." 

- Separations or long distances between people and grou{>s, whether deliberately 
created or happenstance. Walls and barriers of various sorts might be Von - 
sidered means of reducing proximity as would separation Into different 
organizational families. NIMH has minus prox I mi ty wl th respect t6*0E, SftS, 
and HA on both organizational and geographic grounds. 



> Any evidence or planning, ordering, systematic arranging, scheduling, mapping 
In a framework, quantitative analysis or evaluation of objectives, work or 
output, e.g., systems analysis, PPBS , etc. (Obviously such structuring may be 
misguided, excessive or overdone, hence this dimension^ like some others, has 
value only within certain limits.) 

- Evidence or confusion, disarray, ad hocracy, muddling through, lack of organi' 
zatlon, irrational i ty. 



Capacity Any sign of affluence, talent, experience, wlsdon>. Intelligence, strength, or 

size when such is suggested to be a "given" In the situation or a "cause" 
rather than an outcome of other factors, e.g., "so and so was a good writer" 
(talent). "They had a large grant" (affluence). "It was :^ top university." 
"He really knows the bureaucracy, inside and out" (experience,- shading on 
"empathy" factor) . 

- Poverty, inadequacy, outstanding lack of talent, resources, experience, etc., 
especially when cited as a "given" or a reason for something else not happen- 
ing ur not coming out right. 



Openness ■♦• Any sign of willingness or eagerness to lis ten , to receive , to 9 1 ve « to tell , 

or to share ideas, knowledge, or resources with others. Willingness or eager- 
ness to change. Programs to change attitudes usually are intended to Increase 
openness. Willingness to try Out new behaviors probably represents a higher 
level of openness than a mere^ wl 11 I ngness to listen. Oprnness Is not the 
same as being I Inked although either might leaJ to the other. You might have 
a formal link to someone In a very circumscribed relationship in which the 
receiver fnlght not be open to many divarsc torts of messages. On the other 
hand, people can be open to receiving new Information or new contacts and 
still not get them. Flexlbl 1 1 ty of any sort would also rate as "openness," 
as would a willingness to take risks. 

- Any sign of rigidity, dogmatism, unwillingness to listen or to tell, secrecy, 
erecting or maintaining barriers to convnunlcat Ion, shunning oppor t«in 1 1 les to 
comnunlcate or to go after ntw Information and new sources. 



Reward * Provision of financial support, security, esteem^ status, or benefits of any 

kind which can be «een as reinforcements. Hlght Include providing companion- 
ship, publication, compllmenta, encouragement. Increase In pay or power, re- 
Mef from stress or work. 

' Lack of or loss of any of the above, punishment, negative sanction, disappro- 
val . 



EHargv ♦ Haavy Invastrnant of t\m and affort, parslstanca. aflgresi I veness , caring a 

lot, concern for action and movMNnt, achUvemant motivation, high aspirations. 

- Inertia, Indifference, malntananca orlantatlon. 



♦ Coming togathar of forcts , orcha»tr«t Ion, combining of dlvarse elements, 
synchronization of multiple diverse media •nd messages to produce Joint or 
additive effects, whathar by plan or sercn<JlpUy. 

* Lack of Joining of elaoMnti* dlffussnatt of dtvarta afforts, fallura to tyn- 
cbronln, <liih«raionY« 
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The clearest examples in which the Division actually utilizes the homophily 
principle are those projects described as "utilization by subversion/' i.e., 
where professional groups are given special contracts to diffuse R&D findings to 
thei r own members. 

Empathy 

Homophily is usually a "given" in a situation; we are either similar to 
another person or we are not. If we are fundamental ly d i fferent In background, 
race, sex, age, role, job, status, etc., It Is more or less Impossible to achieve 
homophily on these attributes. In such an event, the next best thing Is " empathy," 
by which we mean the ability to put oneself In the other person's shoes vicariously. 
In this context, empathy Is defined broadly to Include any type of understanding 
of the other party's situation. This understanding might be on an intellectual 
level or on an emptlonal level or both. Empathy, by Itself, does not facilitate 
utilization of knowledge directly, but It does put the resource person in a position 
to know how to coordinate users, to know what they need, how they will respond 
to new Inputs, and how they will be most likely to react In a resource r^user 
relationship. Empathy is also dynamically related to homophily. For example, 
homophilous Individuals will be able to empathize with one another much more 
readily than heteroph 1 1 ous individuals, and conversely, those who empathize with 
one another will be likely to develop similar attitudes and awareness, hence be- 
coming more homophilous. 

A D&U unit which stressed "empathy" might want to utilize role-playing, 
simulation, and job-rotation in Its strategies. 

The Manpower Administration's Division of R&D Utilization does exhibit soijie 
concern for the empathy factor through its over-all efforts to involve researchers 
in practitioner problems, but the Interviews provided only a handful of comments 
that could be related directly to empathy. Four comments from two insiders seemed 
to fit this category while six comments from four outsiders were relevant. 

The two Insiders expressed concern that the Division does not know enough 
about what policy makers (in tKe Department of Labor) want. One outsider showed 
this concern, suggesting that "we make policy makers sensitive to R&D findings 
before we make them policy makers." This same respondent noted that he looks 
at new federal legislation before It Is implemented so that he can estimate In 
advance the kinds of research needs that the administrators of the new program 
will have. One Insider also suggested that researchers needed a little more 
empathy with policy makers; the presentations to department staff and policy 
makers were often so bad or so academic that they turned the audience off. . 

One outsider also mentioned empathy with users as a key problem for the 
Division. He felt that USES, as the line agency, was more grassroots oriented 
than ORD and had a better Idea of the problems of the local offices. One in- 
sider also commented that "we don't know enough about what users are using, need, 
and want." 

In general, the Division does not seem to have focused on empathy-building 
strategies directly through such devices as role playing, simulation, job and 
role rotation, or living-ln experiences of one sort o^ another. This may 
therefore be an area for future program Consideration. 

-298- 



Li nkage 



Before any knowledge can pass from one person or group to another, there 
must be some sort of connection between them which allows communication to take 
place. Studies of knowledge dissemination show that D&U effectiveness is re- 
lated to the number, variety, and strength of these connections. In this 
analysis, we have grouped the various statements related to connectedness 
between persons and groups under the heading "linkage." 

In coding the interviews in the Manpower Administration, we found a large 
number of linkage statements: 63 from division insiders, 62 from outsiders. 
We have tried to classify each statement according to the persons involved (as 
senders and receivers) and according to the respondent's perception of the 
quality or significance of the link. The^ results for 103 responses which could 
be meaningfully coded in this manner. are shown in Table 7*11- 

[Insert T^'ble 7- H here] 

A majority of statements (68) indicated either that linkage between 2 persons 
or groups was good or that a specific event occurred in which person or group X 
communicated with person or group Y. Twenty-three instances were cited where 
linkage was unsatisfactory or lacking; in 13 cases (representing 3 inside 
and 5 outside respondents), the importance of a specific type of linkage was 
noted . 

Comments are clearly bunched in the areas most closely attached to the 
respondent's work situation, i.e., among the utilization division and ORD staff 
and from them to others. The highest frequency of linkage is between ORD 
(including the Division) and planning and policy people^ and !n this area, the 
preponderance of examples are positive, particularly as cited by Division in- 
siders (8/2). Although linkage to the line agencies such as USES ranked second 
in frequency {19 instances), the i ns i de^outs i de ratio suggests a far less 
satisfactory state of affairs (8/9). 

Linkage within ORD has been deliberately fostered by the "buddy system" 
policy of several years standing and Is reflected in a ratio of 15 positive to 
zero negative linkage instances. We also note a positive ratio of linkage with 
researchers (12/1), again perhaps reflecting the "buddy" policy. One insider 
noted that researchers were not a priority group for the dissemination of ORD 
products; in fact, however, researchers and academicians of various sorts 
dominate the Division mailing lists and represent the majority of unsolicited 
inquiries for Tnformation. . . 

The smaller frequencies and the many blanks in this table are also note- 
worthy. Communication links to non- researchers outs ide the federal government 
are hardly mentioned at all by those outside the Division although some Division 
staff {k mentions) indicate the importance of this type of- linkage. Linkage 
to the general public is almost never mentioned. The focus of our questions 
may have contributed to this result, however. 

The table generally reflects the situations of ORD; there is good linkage 
within and with a small group of researchers^ but a high degree of frustration 
in trying to link with policy makers and especially practitioners. The path& 
to the mass of practitioner-users are blocked by £he bureaucratic rules and 
structures of the federal system. 
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TABLE 7.11 Linkage as a Factor in Utilization in the Manpower Administration 
(Codable Responses from 15 interviews including 6 in the Division 

of R&D Uti 1 ization) 
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^"Insiders": Staff members of the Division oT RSD Utilization. 
"Outsiders": Manpower Administration Personnel in other Divisions, 
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Proximi ty 




Proximity, the mere fact of being close to someone physically, geographically, 
or organizat ionaUy , is one of the most reliable predictors of effective D&U. 
In the Manpower Administration interviews, 18 instances were clearly codable 
into this category, 9 from 6 Insiders, k from 7 outsiders. 

Conferences (which create a temporary proximity between various groups) 
are a favorite tool of the Division. For example, there is an annual "New 
Manpower Researchers" conference which introduces new Ph.D.'s in the manpoWer 
field to policy makers. The Brookings Institution had a special contract last 
year to introduce research findings from the WIN program to policy mak'ers. A 
conference was the major vehicle for this, but according to one informant, it 
was not well attended by policy people. Other special conferences have been 
held at various times as a major vehicle for reporting successful findings and 
displaying successful demonstration projects. The Division also makes some Out- 
reach to annual conventions in relevant professional fields and organizes dis- 
play booths for various ORD products. 

Some inside staff stressed the importance of personal visiting and direct 
contact on field sites for themselves and potentiaT users . One said that the 
most effective way to get utilization is "to see it." Another said "we don't 
go out enough to the potential user - you. can't just send the report." The 
active role sometimes taken by Division personnel to create proximity and ^ 
promote linkage is reflected in comments such as: "They took down JOBS ^ 
people and others to show them how the (Renter was operating." 

Proximity may play an important role in relations within the Manpower 
Administration since some units are physically housed together, some are blocks 
away, and some are miles away. One ORD research unit head said he had a close 
relationship with the Division of Utilization "since they are in the same office." 
A difficult relationship with USES, the agency with line responsibility for direct 
access to the field, is probably made worse by' both organizational and physFcal 
separation. The agencies are housed in different buildings. Communication with 
the top policy figures in the Department of Labor is probably inhibited by the 
same geographic factor. 

St ructur i ng 

In previous studies of D&U, the degree of systematic organ i zat ion, plann ing, 
and coordination of elements seemed to be strongly related to utilization success. 
This dimension of orderliness of function and process was giver the label 
"structuring." We were able to identify 9^ statements in the J5 interviews which 
seemed to have reference to a quality of structuredness (or lack of it). Most 
of the^4 comments came from those outside the division, 65 vs. 29- Most of these 
were merely statements by respondents concerning how work was organized in the 
areas they were responsible for. For example^ the head of ORD described the 
development of an annual "R&D Funding Plan" as an activity requiring generating 
research ideas within a framework, rating these on specified criteria, planning 
specifically for one year and more generally for two, and taking cognizance of 
future events which may change demands on the staff, e^g., the passage of th?. 
Emergency Manpower Employment Act, Several items ?n this process suggest a 
quality of orderliness and structure. The ORD director also noted some ways in 
which they operated In a less structured manner; for example, he noted that the 
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D&U Strategy is mostly ad hoc, not based on any theory. He also noted that therd^^ 
was no set system for either defining who clients were (depends entirely on 
the product) or how to reach them. There is also no set procedure for finding 
out whether intended users actually are reached and actually use what they get. 
However, such comments were made as statements of fact with little implication 
that the situation was other than it should be. Getting such data on utiliza- 
tion would be like "measuring the unmeasurable." 

The expression "ad hoc" is used over and over again by different staff 
members in ORD, particularly when applied to utilization strategies. To some, 
this "ad hocracy" is merely inevitable but to others, it is something to be 
deplored. One ORD staff member stated it this way: "it Is a matter of bouncing 
from one trisis tO' th e .q ext . . \ .you get away with a lot in an ad hoc system.... 
things don't get done." ""S??^' respondent outside ORD who was generally critical 
of the»r way of doing things said that part of the "failure" of ORD to imple- 
ment research is due to their lack of data on" the use of research and the fact 
that, in his view, they did not build evaluation designs into projects. 

Staff within the Division generally agreed that many functions were carried 
out without a high specification or structuring. The Division director noted 
that in determining needs they didn't do a good job of seeing "whether all bases 
are covered." , 

Capac i ty 

it has generally been observed in all areas of hu.nan endeavor that those 
persons with the most resources to start with will be the most successful in 
whatever they do. Wealth, power, education, and talent can all be acqu i red 
attributes to some extent, but if they are g i ven they will provide an enormous 
advantage. This truism applies equally to dissemination and utilization 
activity. Hence, the larger the DSU unit, the larger its budget, the higher it 
stands in the hierarchy of the Department, the more educated and talented its 
staff, the more successful we would expect it to be. 

What do the interviews tell us on these points? First of all, it does not 
appear that capacity stands out as the major factor in assessments of the 
Division of R&D Utilization. Although there are some indications of problems 
in this area, insiders do not carp about them and one insider vehemently put 
forward the view that money and size have nothing to do with effectiveness. 

Outsiders were far more preoccupied with capacity issues than insiders 
as judged by interviews: eight outsiders made 29 comments related to this 
category, whereas four insiders made only 8 comments. 

Substantively, the outstanding capacity issue noted by insiders and outsiders 
was work load . One sen\of outsider said that the utilization unit was 
"drowning in just getting material out to people." Another echoed this obser- 
vation by^saying that staff time and size limit what the unit can do. One 
senior insider said that most problems revolve around time and work pressures 
and overload on the staff. Most outsiders seemed very sympathetic and 
appreciative of what the unit has been able to do within these limitations, 
although one person believed that many contracts could ^e performed more 
efficiently with greater utilization impact if they were done in USES (the 
agency with line responsibility to the field) "because USES has got the 
organization to deliver." 
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A najor saving factor for the unit was the unit's leadership. Insiders 
and outsiders commented favorably on the director's knowledge and commitment 
to ut n izat i on, and the esprit d' corps, creativity, and flexibility of the 
Division which were seen as consequences of his efforts. 

In summary, therefore, we can say that wealth and power capacity factors 
were inhibiting but not crippling because of inherent capacities and talents 
of the Division's staff to make the most of what they have. 

Openness 

This term has many connotations most often associated with the personality 
and the psychology of individual persons, but in a D&U context we would 
prefer to limit the term to mean simply the "readiness to give and to receive 
new information." Using th i s def i n i t i on^ we mted kl comments pertaining to 
"openness" in the interviews. There are two complimentary questions that need 
to be asked: first, are the Division and ORD open to their important audiences 
and publics and, secondly, are these most crucial audiences open to ORD and the 
Division. On the first point the answer seems to be yes. The Division in 
particular puts great store by its openness; they always try to respond to 
requests from any source,- they actively seek out potential users both to ask 
wha.t-they need ^nd to tell them about new items which might be^ of interest; 
and they try to get users involved in reacting to rese^'irch proposals. To 
serve these ends, they use many media including person-to-^person visits to key 
persons, preparation of written policy briefs, demonstrations at conventions, 
etc. 

J ■ 

The second question, that of the openness ^of others to ORD and the utiliza- 
tion Divi-sion," must be answered somewhat differently for different levels. 
At the high^^r levels of policy making within the Department of Labor there appears 
to be considerable openness. Policy makers were reported by one reasonably high . 
source as "receptive to research results and even asking for more." One indi- 
cation' of this eagerness has been the specific request from the Assistant 
Secretary for Planning, Evaluation, and Research (ASPER) for briefs on research 
reports which spell out policy implications. There is also some feeling that 
these same policy makers do not convey their enthusiasm down the line and to 
the field. Some^members of ORD wouId*like to see a louder and clearer sanction- 
i r>^g of research utilization from the top. There was also some complaint in the 
Division of "restrictive media policies," presumably laid down from on. high, 
whIcK inhibit fully adequate mass dissemination of important findings. 

Hov/ever, most comments concerning lack of openness pertained to the wing 
of the Manpower Administration with the most field responsibility, namely USE^. 
One Division staff member noted "a traditional mistrust between operating and 
research people." One policy planner felt that program people have "short 
horizons" because they are required to meet present problems. Another Division 
respon-dent said that he had also Initially found it difficult to get important 
Information out of people in USES. As noted elsewhere in this report, ORD-USES 
relations kee4>--iomi ng up in our interviews as problematic. "Openness" is a 
big part of this picture, although we cannot be sure whether it is a cause or 
an effect or perhaps merely a symptom of a more fundamental difficulty. 
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Perhaps partly because of the gatekeeping powers of USES in this regard, 
relations to regions and states were also noted as being weak. Whether this was 
a true la.ck to openness in the field or merely a lack of contact is hard to 
judge. Certainly when Division staff put on displays at professional conven- 
tions, they are overwhelmed with follow-up requests: sometimes as many as 
1000 requests from a single convention and 500 for a single report displayed 
at a convention have been counted. These figures suggest a good deal of 
openness and a great need for' R&D outputs at certain levels. Unfortunately, 
the Division is usually too busy responding to such waves of requests either to r 
note the types of audiences being turned on or to assess the true ultimate 
impact on these audiences. 

Reward 

It is a fundamental, psychological fact that rewarded behavior tends to 
be repeated. This principle applies very strongly to sending and receiving 
messages: people won't keep doing either for very long unless there is some sort 
of direct or indirect reward or reinforcement for, doing so, nor will messages 
have "Impact" if they hav^'^no reward value for those who receive them. Hence 
the pattern of rewards for D&U has to be observed and rated for its adequacy for 
all parties to the exchange if we are to make an adequate diagnosis of D&U 
p rob 1 ems . - ^ 

Using this definition, we find very little focus on reward issues in the 
interviews (22 comments in all, 10 from 7 outsiders, 12 from the six insiders). 
The* Division is rather proud of its- careful husbanding of financial resources 
and its use of them to prime the pump in certain areas. 'Relatively modest 
grants have been made to unions and to prof ess ional groups to "subvert from 
within" to involve these potential users in utilization efforts. The TAT 
project was noted by a respondent as one that was initially funded by ORD but 
now operating without such funds, with Union Carbide agreeing to pay for the 
training of those people they were hiring. 

The .importance of rewarding the researchers or the ORD staff, itself, was 
rarely mentioned. One hTgh level respondent suggested that the interest of 
the researcher was a crucial factor, while another noted that the use had to 
be involved and that his self-interest had to be appealed to. ^ 

The Di V i s ion. d i rector noted that his D&U Division often does not get 
credit for its own work, but that this did not g reat 1 y. d i s turb him. In 
any case. Division staff .may get their rewards in different ways, e.g., 
through their esprit and the Innovative atmosphere generated in the Division. 

We believe, that the reward systems of the various segments of the 
Manpcwier Administration would explain a good deal about linkage problems, 
especially among ORD, OPE, and USES, where linkage difficulties abound. 
Some rewards can even come about through effective communication alone. For 
example, one OPE staff member noted that ORD often sends proposals for hts 
comment but that he gets no feedback on what they did as* a consequence. 
Possibly such feedback loops could be initiated by promulgating a. formal policy 
to this effect, at least on a trial^basis. 



Energ'y 

■ < \ 

^Everett Rogers and others who have 'Studied the influence of various, 
factors on the diffusion of Innovations have noted that success is often * 
correlated with degree of effort invested by the change agent, himself. Al- 
though we are not sure how this concept manifests itself 'in the workings of 
a federal research utilization program, we^ thought it would be a wor'tbwhile 
dimension to consider. The .term ''energy'' is used here to denote larger than 
normal investments of time, effort, persistence, ag ress i veneS5^ and con- 
cern for acting early and moving quickly. - 

Twenty-five comments seemed to fit this category, 13 from insiders, 12 
from outsiders^ One Division staff member noted that "a good project officer 
with commi tment- to utilization and^interest in getfi ng sp i n-of f " is an impdrtant 
facilitating factor, while a "lazy" prc'ect officer who doesn^t get involved 
is an Inhibiting factor, TKls statement -is close to the essence of what is 
meant by "energy." In fact, as a matter of deliberate policy through the 
"buddy system" and other means, the Division stresses the importance of involve- 
ment from the beginning. Probably the most important thing that can be done 
by any agency to get utilization is merely to stress it, to say it i5 important 
from the beginning and continual |y throughout the course of a project. One ORD 
staff member exemplified what seetned to be a general 'attitude with this state- ' 
ment: "I wori< w^th a project atid do every\hin^ in the nam^ of getting it 
utilized and consult with Drob as t am doing tliis." 

Synergy ^ ^ 

"Synergy" basically means the combined action of different; forces to pro- 
duce a single effect. It has been observed in past D&U studi.es that utilization 
was not the result of one factor or two factors operating additively but vyas 
the result of a combination qf^factors that went together in" a certaip way. 
Personal influence, for example, is very ' t mportant in bringing about change but 
usually wori<s brfly when it is (a) responsive to "an inte»:nal need in the user, 
(b) supported by. reasonable evidence of effectiveness, and, (c) offered by more 
than one source. We wanted to see if federal D&U units manifested a synergy 
principle in any of their strategies. 

In our interviews in the Manpower Administration, we turned up 23 Comments 
which might be interpreted in' this way. ft is clear that the "synergy" idea 
in some form or -other is important to many of our respondents but expressed ^ 
differently. One respondent stated 't in the following way: "You must fit the ' 
right man at the right time--you must have a current hot item." Another 
echoed this view by saying, "it*s the right idea whose time has come that 
counts." "Timing" was repeatedly noted as a major positive factor and is one 
important aspect of synergy; research input must come at the same time as other 
inputs to users such as awarenees of needy urgent preesure to change ^ ""the 
opportunity to move in a new direction^ the sudden acquisition of new resources 
or the necessity of making a decision. ' ' • , 

A synergic strategy requires two things above all: first, a continuing 
awa/reness of current user needs and situations, i.e., "where the user is at" 
.and", secondly , a coordination among resource persons and groups so that joint 

1 ■ ' ' 
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timing is possible. .Dn the former point, the D&U Division in the Manpower 
Administration can claim some success in specific areas. In some projects in 
which user involvement is stressed from the outset, bpth users and researchers 
have a chance to keep track of where each other Is going from one time to the next. 
For users in general, however, It is difficult if not impossible to retain such 
an. awareness . To some extent, the Division and ORD as. a whole depend on 
signals from higher up and from Congress to jud^e what is needed at specific 
times, but some insiders felt that they were "of.erating in a vacuum" since 
they do not know what policy issues are important to decision makfers. 

Since planned synergy is such a difficult strategy to work on, dissemina- 
' tors often fall back on a strategy which might b.e called "natural" or "serendipi- 
tous" synergy. What this means in practical terms is that pne floods all media 
with as many "potentially" relevant messages as possible anci keeps repeating 
the messages so that users will be able to review them when^er thiey'are ready, 
wherever they are, and whatever me^dium they are attending to N-4ri many respects 
the 'U.S. market economy works just this way. -We did not^^' rid"^too much of this- 
"flooding all zones" philosophy in the Division. Indeed there was a tendency 
to be selective in choosing audiendes and timing inputs and to play down mass 
d i ssemi net ion activities. 

One ORD staff member outside the utilization Division may have expressed 
the synergic principle when he said "we play the orchestra as we think the 
musiqwlll best be heard," employing memos, monographs, letters," and research 
academicians in wh'.tever combination seems best to get across a particular 
message -to a particular audience. 

" C. 'THE UTILITY OF H-E-L-P S-C-O-R-E-S ANALYSIS 

We^should recognize the fact that we are still at an early stage in under- 
standing D&U phenomena. Thus, elaborate statistical an*d conceptual models 
^ are probably not going to fit the'^facts of very many specific situations. It 
■■■ should also be e.Tphas i zed , however, that HELP SCORES is not a theory in this 
>^ sense but rather a set of broad and distinct descriptors for ajpects of D&U 
process. Most of the ten concepts can be, applied to any transfer situation 
or D&U happening,/ regardless of where such a happening may be located in- the 
^knowledge cha i n ^desc r i bed in Chapter Three. 

In the previous section we offered a very small test of this 10 concept 
approach by coding ir03 process comments or statements from 15 interviews. It 
is our view that the 10 concepts covered comments from all persons inte'rviewed 
quite well. Table 7-11 provides quantitatrve overview. As indicated in- this 
table, the 10 concepts are not of equal explanatory power. "LFnkage" and 
"structuring" account for over half the total comments coded, and "openness" 
and "capacity" account for nearly another 20%. "Empathy" and "homophily," on 

[Insert Taole 7. I'l here]. 
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the other hand, seem to play only a minor role in the thinking of these 

respondents about D&U, together accounting for only about k% of total comments. 
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TABLE 7. H H-E-L-P S-C-Q-R-E-S Within the Manpower D&U System 

(An Ana^lysis. of ,^03 Process Comments from 15 Interv'iews) 





- Staff of the 
RSD Ut i 1 


D i V i s i on of 
i zc t i on 


Pei'sonnel Outside 
the Division 






Number of 
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(Total -6 J 


Number of 
Comments 


Number of 

rvc b pun uc n L D 
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n uiHu c r o I 
Comments 


To ta I 
Comments 
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k 
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3 
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Empathy 
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6 


10 


Linkage 


(6) 


63 


(9) 


62 
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Prox imi ty 


(6) 


9 


(7) 


9 


18 


St ructurl ng 




23 


(9) 


65 


9^ 


Capac i ty 
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8 


(8) 


29 • 


37 


Openness 


. (6) • 


20 


(7) 


22 




Rewa rd 


(6) 


12 


^ (7) 


10 


.22 


Energy 


(6) 


13 


(8) 


12 


25 


Synergy 


(5) 


6 


. (7) 


17 ■• 


23 



We have sopie sense that- the low-scoring factors are. low'in part because 
they have '(^een less visible and have beeh given less focused attent i on- than 
some of the others. The pattern of responses undoubtedly also reflects the 
pattern of the stimuli which certainly bias- the response distributions among 
the 10 code areas; for example, many of our questions stressed communication, 
and linkage mentions are probably increased b^c^use of this. The comments ii^ 
this case have been coded into the schema post hoc wi th some success but, 
if we are to pursue such an approach, there is now the need to present the ' 
schema to resportdents hore explicitly, factor-by-f actor^ to elicit more specific 
responses, . ^ ' 

We believe that HELP SCORES shows promise of becoming another useful 
descriptive schema for analysis of D6U activities, D&U strategies, and D&U 
systems, and one which cuts across the functional analysis of Chapter Four 
such that each act of transfer can be- subjected to it, whether such act occurs 
within the user system, in need communication, within the resource sys-'fem, or 
in transfer from resource to user. Even in its present form it has provided- 

er|c „ / 



d different view of the Manpower Administration's DSD system as reflected in 
the comments of 15 persons very centrally linked to or associated with that- 
system. 

<- 

We can further simplify and summarize our conclusions here and illustrate 
how they converge with those of the first part of this chapter by grouping 
the responses in four conceptual clusters as follows: 

(1) Linkage and Proximity: 1^*3 Comments 

(2) Structuring and Synergy: 117 " 

(3) Capacity, Energy, and Reward: ^ 8^ " 

(4) ^ Openness , Empathy, and Homophily: 59 " 

there is some logical justification for each of these couplings. Being 
physically close or in contact and being linked together are clearly related 
and often hard to separate in coding. There is also a dynamic relationship 
between linkage and proximity In that proximity greatly Increases the prob'abillty 
of linkage and good or strong linkage tends to lead to associations and meetings 
which bring people together physically. 

"S^ner^gy" requires the joinj efforts or effect,^ of. several Inputs simul- 
taneously or' in succession. This may occur by chance and often does in real 
life, but a deliberate strategy of synergy would certainly require a good 
deal of advance planning and ^tructurirtg. • ^ . . , 

"Energy" can be seen both as a consequence and as an aspect of^* high 
"capacity," while '-^reward" can be seen' as both a cause and ar effect of both, 
i.e., -one aspect df^Mgh capacity is being ableTto provide rewards, arid re- 
ceiving rewards builds one's capacity. The pnpsp^ct of reward tends to release 
energy 7)'and the expenditure of energy, especi'arly by a high capacity system, 
leads tJo jrevfards:: Thus in s-everal ways, these three "concepts are intertvv^i ned. 

Fi na^ 1 y,'*th^ «not loti ^ of "empathy" implies "openness" to others while '-homo- 
phily" defe'cribes ant important precondi tion -for both "empathy" and "openness." 

These four ^ogical c 1 us ters doveta i 1 in^n Interestirig way with the factorial 
dimensions dyisc^u^ed In the first part of the 'chapter, end especially with the 
three items v)ti,Jch we selected out of the 20 "procedures" as most salient agd «^ 
r,epresentat I ve of our principle findings. /'Li.nkage and Proximl ty" /i ts nicely-" 
with the top-rated item "Collaboration and cooperation between researchers and. 
userfi to find and adopt what Is useful." "Openness-Empathy-Homoph i Vy'*' relates 
Somewhat cleaVVy to the, item "Adequate diagnosis of tfyk real u^er need" and 
finally "C=ireful organization of the planning and implementation efforts" is 
very closely relajted to what \A/e^ have been calling "Structuring and Synergy" 
in this section. / ' . ' 

We ar"^— Left with tf^e-'^Tfapaci.^y- Energy- Reward" cluster which ^Iso bears 
close likeness to the Capacity dimens Ion .which emerged so clearly and•^4is_yi 
from our factor analysis. 




We cannot claim that the data offered and the analyses attempted in this 
chapter lead us to any firm or final conclusions with respect to DsU process, 
but there does seem to be a convergence with respect to at least four clusters 
of variables. The strongest and most salient of these is linkage^ the connection 
and two-way corrmun i cat ion among users, and resource persons at all levels. A 
good utilization system is, above al 1 , a highly interconnected and interactive 
system with no gaps between key users and key resourcers. 

Secondly, a good DS.U system is highly open arfd responsive to user needs^ 
understanding and appreciative of the user's situation and able to diagnose 
his needs accurately and completely. 

Third, a good D&U system is clearly planned', organised and coordinated to 
achieve its objectives, using systematic evaluation and feedback to maintain 
quality control and improve functioning, 

. V/' . ■ ^ ' ' ' 

Finally, a good D&U system must have the capacity in financial, personal, 
and motivational term^ to support its objectives and reward those involved 
either on the sending or receiving ends of the problem-solving dialogue. 
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CHAPTER VI I I 



POTENTIAL PRACTICE MODIFICATIONS 

I . INTRODUCTION 

The schema elaborated In this report can best be judged by its power 
to provide useful guidelines to action for those engaged in D&U programs. 
At this point, therefore, we would like to bring together our observations 
from the four agencies, the two surveys and the two conferences, to sum- 
marize and to derive implications for action, following the major categories 
of ana 1 ys i s . 

A. SUPPORT OF USER.,^SE.LF^SERVICING 

"An effective and progressive user self-servicing subsystem 
has a good loca 1 i zed prob 1 em-so I v i ng capac i ty , ma i n ta i ns a con- 
tinuing awareness of its needs, present and future, knows how to 
express its needs to potential resource persons and groups, looks 
outward and inward for innovations, and is able to adapt new ideas. 
Maxima) DSU activities in this area would focus on. helping the user 
help himself by providing training or support on any of the above » 
sub-processes . 

We have found that each agency studied sees this as an important area 
but not necessarily one that they have the capacity or the jurisdiction to 
work in. None of these four agencies sees the user as the passive recipient 
of information; all accept a self-servicing problem-solver definition of 
clients and client systems. The real question for them, then, comes down to 
this: are the limits of responsibility and capacity of a DSU unit? 

If the client group is. relatively well defined and limited, it is possible 
for a ^6U agency to provide t{ie kind of consultation and support implied 
-tJy 'thTs function. Th*us in the case of the NIMH unit, where community mental 
vhealth ceaters were the primary client, such help was provided directly by 
agency^Staf f . At the other extreme, the NCEC,with a client population of 20,000 
school djs;tricts, hundreds of thousands of teachers, and sundry educators^ can 
hardly expect to indulge very heavily in direct support of user self-servicing. 
On the other hand, f>ICEC has developed a strong philosophical orientation com- 
patible with user self-servicing and problem-solving and tries to find ways 
to fill its other D&U tasks in accord with this philosophy. Both the NIMH 
and NCEC strategies in this regard are reasonable but require entirely 
different types of resource allocation and organization by the federal agency 
as a whole. To adopt an NIMH strategy to serve all clients of a particular 
federal agency would be very costly and would require a complete rethinking 
of both the meaning and significance of DSU at the top levels of government. 



■'^For readers' convenience we will repeat, descriptive summary of each model 
component from Chapter A. 



A large number of psychologically-oriented change theorists endorse 
the strategy of supporting user se 1 f -se rv i c i ng . - There is sound logic and 
some evidence to support this "client-centered" approach to helping. How- 
ever, there is a danger in exclusive rejiance on such an approach, namely, 
that the legitimate value of outside knowledge, especially that based on 
valid R&D effort will be discounted or ignored. We feel that this danger 
is real because change experts, trainers, and consultants tend to cluster 
accord i ng to i deology and to see other emphases as representing compet i ng 
ideologies. In the minds of many client-centered change specialists, any 
emphasis on knowledge transfer represents such a competing and distrusted 
perspective. It is difficult t>6 find persons who represent a dual orienta- 
tion on the importance of both user self-helping and transfer of expert 
knowledge to the user from outside sources. 

Assuming that in the near future D&U units will not have greatly increased 
power or resources, we would make two summary suggestions regarding user self- 
servicing. The D&U unit must assume: 

(1) that the user can help himself on many aspects of problem- 
solving and 

(2) that for the extent to which major help can be provided 
by the federal government to users on the process of 
problem-solving and sel f- improvement (personally or organi- 
zationally), other branches of government will need to 
provi de it. 

On a more specific level, there are three types of actions which D6U 
units might contemplate. We*will rate the pros and cons of each in turn 
below. 

1. Training in Problem-Solving Procedures for Practitioners (exclusive 
of training Tn research utilization, per se) [Improvement Option #1] 

None of the D&U units engages in this activity to any extent 
and, given their limited resources, this seems wise. 

We feel that there is a great need throughout the society and 
particularly in the profess ions and servi ce-p rovi ding organ i za t i ens 
for improving these skills. There are training programs and pacKages 
available in this area. However, the reliability and long term benefits 
of such programs are generally not proven and the cost can be high 
particularly in terms of negative ripple effects from unsuccessful 
training efforts which could put the whole D&U function In a bad light 
in some circles. Our own expe r i ence with two conferences in which 
siome problem-solving proces^s traihing was included suggests very great 
differences in receptivity to this approach. Most experts in this field 
would argue that problem-solving process training is not a task which can 
be undertaken from a distance by personnel busy with other activities. 



^ '^See for example: Bennis, Benne and Chin, THE PLANNING OF CHANGE I969 
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The most effective models for such work involve long term commitments 
.from process training experts willing and able to learn the operations, 
goals, and problems of their client organizations thoroughly. Quick 
courses in management or sensitivity training, in general, are not 
effective for improving group process. 

Two additional difficulties should be pointed out: first, it is 
almost a truism that the groups most in need of process development 
are the least willing and/or able to seek out the iielp they need. 
Second, changes in process are vexingly difficult to evaluate for '*hard 
improvement in production of the organization, at least over the short 
run . 

Thus, the appropriate stance of the D&U unit vis a vis process 
training probably should be that of a concerned outsider who may be 
able to suggest this work to organizations who appear open to it, or 
who might strive to create conditions in which the need for process 
training becomes clear to organizations which are not initially open to 
the suggestion. The D&U unit, through its contacts with these systems, 
might serve as a linker or resource bank by keeping a file or personal 
contact with skilled process trainers. 

It is usually unrealistic to expect effective problem-solving pro- 
cesses to develop in short-term, temporary groups even with expert 
process guidance. The two interface conferences attest to this fact. 
D&U is a complex field within which we cannot expect any temporary 
group to be able to derive specific actions for change in a limited 
period of time. Thus, D&U staff might wish to consider the development 
of long term problem generation/analysis/solution mechanisms, and apply 
the best problem-solving processes known to the establishment of these 
activities. It could be argued that such long-term training-consulting 
projects could be cost effective if they were provided to a clearly 
defined client group of very high power and high relevance to the D&U 
unit (such as the Planning Office, Bureau Chiefs, etc). However, it 
is difficult for lower power groups to initiate such activities for thei 
own superiors. Again from the interface conference experience we found 
some difficulty both in attracting higher level persons to participate 
and in holding their attention, once they were present. These problems 
are solvable but they must be confronted and planned for in advance. 

2 . Organ i zaMona I Development (OD) Consultation and Intervention 
[improvement Option #2] 

The same type-^ of considerations which apply to process train- 
ing also apply to OD and similar types of interventions. Cost is 
high and efficacy is uncertain. The NIMH unit has involved itself 
in a kind of OD consultation with community mental health centers 
but has been careful to keep this on an informal basis< Manpower 
has sponsored one Laboratory (in Michigan) where organizational 
survey and feedback (a type of OD) was tried out in a number of 
employment services with mixed results. A major stumbling block 
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for this activity was gaining access to sites. In the case of NIMH 
an expectation was already in place that the Washington office had 
a Jegitlmate right and obligation to provide some sort of help and 
guidance to local units. The Manpower D&U unit has had no such sanc- 
tion, and entree is a continuing problem. 

It may well be that some sort of organizational development 
work is a prerequisite to adequate research utilization on the 
argument that learning cannot take place from outside until there 
are adequate structures and linkages within the organization for 
communicating and transforming knowledge received. Utilization usually 
means change y and many organizations mus^^ first learn how (cognitively 
and behavi oral 1 y ) to change. If this is the case, then federal DSU 
units should be linked to other agencies of government responsible for 
organizational renewal. In the case of SRS , for example, an office of 
Organizational Development did exist which might have played an important 
cooperative role with the Research Utilization Division.* In any case, 
the D&U unit should not take it upon- itself to fulfill this function on 
i ts own. 

3. Development or Adaptation of Systematic Tools and Handbooks 
for User Self'Help [Improvement Option ff3l 

One way in which D&U agencies can fill a useful role with re- 
spect to user se 1 f "Serv i c i ng is by developing specialized 
"process" handbooks. All four of the agencies studied have been 
in the handbook business but not all have developed handbooks and 
materials exclusively focused on the proaess of problem-solving. 
NIMH and NCEC have both sponsored wide ranging literature reviews 
on change strategies with a focus on research utilization. In each 
case both compendia of findings and more practically oriented guide- 
books have resulted. What still seems to be needed are experiments 
to find optimum means of disseminating and gaining full utilization 
of such items. It is also not known who uses these hand books, for what 
purpose, whether they improve problem-solving for those who use them, 
and whether they have any effect on the dissemination and/or utiliza- 
tion of relevant research and /development, 

The Manpower Administration has done the least of the four 
agencies in this area and might well consider adapt i ng and comb inlng 
elements of existing works from the other agencies with a special 
concern for Manpower users. As an approach to user self-servicing, 
v/e believe that handbooks on the process of change might have relative- 
ly high pay-off for little investment for several reasons: 



•-'This office was abolished in an SRS reurcjani i?di Ion In the fdll o! 1973. 



(a) low initial cost of development especially because 
similar works of reasonably high quality can be 
adapted . 

(b) reproduction and dissemination is relatively cheap 
a n d s i mp 1 e . 



(c) there Is minimum threat; potential users can choose 
to scan, read or absorb whatever parts of a book 
they deem relevant or interesting and they can do 
so at a time, ^lace, or situation of their own 
conven i ence. 

(d) information on processes of change can be generalized 
to a broad range of situations. 

(e) information on process is less likely to become 
obsolete than detailed information on particular^ 
programs or particular R&D projects. • 

If this is a route that the Manpower D6U unit wishes to pursue, 
they should be especially concerned about two issues: first, to get 
writers of the highest calibre and understanding to do the work, and 
second, to get writers who can present a balanced perspective on chang 
which includes R&D utilization as an important element. 

Such print systems should be evaluated against good in-person 
process training however, especially considering the points made earl i 
about the difficulties of doing process development by "long distance. 



In general, it would appear that support of user self-servicing is 
more important to the D&U unit as a guiding philosophy or ultimate goal 
than as a basis for particular program thrusts. The unit should always 
be seeking ways to encourage better user problem-solving without accepting 
primary respdns i b.i 1 i ty for either training or consultation in this area 
unless it can combine forces with others on whom this responsibility 
natural ly fal Is. 



B. NEED SENSING AND NEED COMMUNICATION 



"Maximal D6U functions in the area of need processing would 
include various activities required to communicate user needs to 
resource persons and systems. Transformation activities such as 
need arousal, need sensing, need definition, and needs assessment 
are necessary for transmission of needs to policy makers and to the 
R^D community. Additional specialized transformations include the 
translation of need priorities into research and development programs 
with dollar authorizations and into problems amenable to R&D." 
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It is safe to say that D&U units will never be seen as the prime agents 
or conduits for need sensing and communication. To start with, at the 
macro level this has been traditionally a political process. V/hen the 
members of the society feel a sense of urgency about one problem or another, 
they communicate their feelings to elected officials or they elect new 
officials who say they can do something about these things. 

Actually in a large and complex society the strictly political mechanisms 
are probably only relevant for setting the broad limits of policy especially 
at the federal level. Thus, judging wha^i^the people need and want is a 
complicated matter and practically every form of information gathering is 
used by federal agencies for this purpose from surveys to subjective judgments. 

^11 four of the agencies studied are very sensitive' to the problem of 
user need communication even though they have no major assigned responsibi- 
lities in this area. They recognize the fact that research utilization must 
be a two-way process involving dialogue and responsiveness by both the R&D 
community and practitioners. However, only the NCEC has conducted formal 
need surveys of varieties of users, while Manpower and SRS D&U staff rely 
heavily on guidance from higher authorities, (n Manpower, high level outside 
advisory committees are important in addition to inside policy makers and 
planners; SRS in the last two years has moved very swiftly toward a formal 
and elaborate internal planning process.' NIMH has up to the present relied 
heavily on expert opinion in the determination of priority "need" areas for 
research. Such experts generally are drawn from the R&D community, itself. 

What is evident from our review of the need sensing and communication 
apparatus in all four agencies is its haphazardness and general lack of 
empirical basis. It is mostly founded on personal judgments and hunches 
of middle level government officials together with those members of the 
academic research community who happen to have good government connections. 
This also makes need determlnat Ion susceptible to misrepresentation, sensa- 
tionalism, and other distortions by need sensing through the media, from 
vocal partisans and from others who may not truly represent a system_and 
its needs. — — 



Lacking the authority or capacity to define user needs and to influence 
research to accord with such needs, the D&U unit is in a somewhat awkward 
position. .As the disseminators, they are seen as representing the knowledge 
producers and are perhaps accountable for the validity and relevance of what 
is transmitted to users. The hope of the D&U staff must be that the store- 
house of knowledge they have to work with is filled with material of reason- 
able quality covering a wide enough range of concerns to meet most user 
needs as they arise. For most of our agencies this is a forelorn hope. 

1. User Info rmat i on Need Measurement and Assessment [Improvement Option 

~ — — ^ 

Only one of the four agencies, NCEC, has made any significant 
th rus t towa rd quan t i tat i ve i nf orma t ion needs assessment on a sys tema t i c 
basis. We do not know why the other agencies cannot begin modest 
experiments in the same area. A first step is to define as clearly 
as possible who the potential user populations of the agency are. A 
" second step is to prioritize these users, and a third is to determine 
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hcM they are currently being served. Beyond these steps there are a 
variety of V/ays in which needs might be elicited. Traditional surveys 
may yield only laundry lists of traditional topics, but intensive 
interviews and/or observations of representative users in their work 
situation might provide a ftjnction of more substance. It is also 
possible and desirable to assess needs in terms of reactions to 
samples of information input. Many users will be only dimly aware 
of many of their information needs, but are able to respond "Yes 
that's what I want" when they are given enough different samples 
of information to try out. Eliciting such feedback can also have a 
secondary benefit for the D&U agency by demonstrating a concern 
for dialogue with the user and responsiveness to him. 

We believe that traditional survey approaches to needs assess- 
ment are useful only to reaffirm and to assess the current levels 
of need according to traditional need categories, and they ignore 
the important steps of "Need Arousal" (2,1 in Figure I 11-3) and 
"Need Definition, Redefinition, and Analysis" (2.3 in Figure III-3). 
If new needs, reformulated needs, and important 1 atent needs are to 
be assessed, users must first be stimulated to think in new ways 
about their situation. The DSU unit could play a very important 
role here by commissioning well-written and provocative essays by 
knowledgeable and thoughtful persons in the field, propos ing such 
new need constellations. Such papers could then be disseminated 
among relevant audiences and used as stimulators of a neu) need con- 
eaioiisnese prior to or as a part of any needs assessment surveys. 

Such a stimul us- response approach to need^ assessment might 
not yield data any more valid than traditional approaches^ but it 
would indicate a great deal about (a) the stability of self-percep- 
tions of need, and (b) the willingness of users to think about their 
need situation in new ways. « 

2. Responding to Stated Needs as a Veh i c 1 e to. Greater Need Awareness 
and Awareness of Resource A1 ternatives [Improvement Option ^5] 

The D&U unit may feel frustrated by the types of response it re- 
ceives on user "needs," either because they are superficial, or call 
for information beyond their capacity to provide. For example, in 
both user network surveys conducted for this project, the highest "need" 
expressed by both federal policy and administrative personnel and practi- 
tioner groups was for information on how to evaluate performance and on 
statistical data of various sorts pertinent to such evaluations. Even 
if they had no initial competence in such areas, the D&U unit might 
want to tool up to provide some such services and/or to link these users 
with others who could provide them. In the course of so doing, however, 
the D&U. unit should (a) piggyback additional R&D information whjch they 
feel might prove germane to real user needs, and (b) ask for feedback 
from users regarding satisfaction with material received, redefinition 
and further specifications of the original need, and articulation of new 
needs. Both the information and the feedback request might serve to 
reeducate the user regarding both his true need situation and -the type 
of services which the D&U unit might be able to provide, 
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3. Long Range Need Definition and Forecasting Mechanisms [Improvement 
Option #6] 



A matter of continuing frustration to D&l) units is the long 
turn-around time between the identification of important needs and 
the availability of new R&D products relevant to those needs. In 
some areas the R&D output jj^ need relevant but relevant for a need 
which was salient a decade ago! If turn-around time is 5 years or 
more on a complete cycle of research, development, evaluation, and 
dissemination, then needs must be held constant or must be predicted 
at least 5 y^ars in advance. 

Need forecasting is certainly a crude art, but it is obvious 
that we should try to do it and^ at the very least, we should try to 
find out how to do it. The D&U unit does not necessarily have the 
assignment of organising think-tanks and the like to work on such 
matters, but they are in a critical position with respect to one aspect 
of forecasting, namely, the prediction of future needs from current 
reactions to new inputs by opinion leaders and innovators. 

A considerable body of research indicates that new ideas. Inno- 
vations and even perceptions of need spread in a predictable- manner 
through the social system starting with key influential persons and 
persons with a history of adopting new ideas early; if such individuals 
can be identified, their reactions to existing R&D products or to 
need stimulus essays {such as suggested under point B-I) should be pre- 
dictive of much more widespread concerns of 5~10 years hence. 

C. BRINGING PRESSURE TO BEAR ON THE R&D COMMUNITY 

"Although most solution building functions lie outside of 
the domain of D&U, three processes can be* identified as maximal 
D&U activities in this area: influencing R&D to be more relevant 
to society; influencing R&D to be more disseminable and utilizable; 
and research on the. process of utilization itself.** 

Early patterns of research support in social problem areas followed a 
model which had seemed to be successful in the natural sciences, namely to 
allow the research commtfnityj itself^ to govern and to assign awards on the 
basis of merit as methodological ly .sound research and as contributions to- 
a coherent body of knowledge. There is less and less pat i ence wi th. th i s 
approach on the part of government agencies today and more of a tendeitcy to 
demand or encourage by whatever means R&D products which have demonstrated 
relevance and utility in the specific ared^S of concern to policy makers. 

There is still some confusion, however , ^about how best to bring about 
a greater responsiveness and a more earth-bound and practical orientation on 
the part of the R&D conwiunity. One .approach , tried most extensively by OE 
and SRS among our agencies. Is to develop short and long-^term (one and five 
year) plans including specific objectives, and to provide R&D funds only 
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for work which clearly pertains to those objectives, usually by competitive con- 
tracts following issuance of a "Request for Proposal" (RFP) . This highly 
planned approach appears logical at first glance but it rests on two shaky 
assumptions: 

(1) that the officials who develop the goal statements and write 
the RFP's have the requisite expertise and the best grasp 
of'the situation; and ' 

(2) that the most competent and conscientious members of the R&D 
community will come forward with proposals, and will win the 
competition for contracts. 

With respect to the first assumption it is probably true that federal officials 
are in the best position to take a truly nat tonal perspective on problems, but 
they are generally not the persons with the most expertise on any given topic ^ 
and they are rarely afforded the opportunity either to understand user problems 
in depth or to reflect on the kinds of R&D that would best meet the needs of 
the country. 

The second assumption holds true only in times of extreme scarcity and 
even then only for those R&D persons who do not^ have tenured teaching posi- 
tions on prestigious university campuses. Thus, for example, in the late 

T96Q*s when the USOE threatened to terminate a lushly funded R5D Center at 

Harvard*s School of Education on grounds of relevance, the Harvard professors 
thumbed their noses at the government and went about their business. The 
Center was terminated; the loser was probably the public. 

The NIMH Branch that we studied is probably the most highly sensitive 
group in NIMH to questions of relevance and utilization; yet they feel the 
need to work in a very car^.ful and diplomatic way with their academic ad- 
visors and with their grantees to instill some degree of relevance in the 
proceedings. 

-Between the NIMH and the OE approaches there must be some middle ground 
which entices the best scholars to work for the good of the society as a 
whole while retaining a sense of Independent judgment and self-control which 
seems necessary for the best scientific work.-'^ We understand the frustration 
of government administrators and the temptation to produce relevance by 
exerting power and coerc'on on the scientific community, but we doubt if these 
stringencies will produce the desired effects for the reasons stated, i.e<, 
(1) that the government at any point in time doesn't really know exactly 
what its needs and top priorities are, and (2) that the best qualified and 
most imaginative R&D people won't work for them if they have any alternatives 
(which they almost always have). 



:VSee the work of Pelz, Donald C. and Andrews, Frank M< , Scientists in Qrganiza- 
tions (Wiley, 1966) for findings on the need for tension between autonomy and 
stimulation from others and from problems to bring about maximum productivity 
and creativity in the scientist. The "trick" in applied R&D is to work clients 
and their needs Into the scientists' awareness so that real life problems pro- 
O te part of the stimulation, d i vers i ty , 'and "dither" so necessary for scientific 
ERfcativity. 



1. Require Need Relevance in RoD Proposals [Improvement Option #7] 



All of the agencies studied had seme sort of mechanism to require 
or encourage need relevance in proposals. In SRS and OE the bureaucra- 
tic machinery of a formal planning process played a large role^ and the 
D&U unit as such had very little if any influence on research funding 
or proposal writing. The NIMH utilization staff had a great deal of 
informal influence through pre-submi ss i on discussions with prospective 
grantees and through proposing and gaining acceptance of relevance- 
related selection criteria by their outside review panel. None of 
th Is^ i nf 1 uence extended beyond the bra'nch to other research funding 
units in N ! MHj however . 

It is possible and reasonable for government to mandate need 
relevance in all proposal s , particularly those submitted to agencies 
wi'th a specific set of service-supportive goals (such asr a]]^ of the 
agencies we were studying). The problem, however, as with all man- 
dates is to get compliance with the spirit and not the letter of the 
law. A research investigator can always wind up w'th a need rationale 
which sounds convincing and sometimes may even be able to ci te. supporting 
dia^nost^lc data. But where does his rea 1 interest lie? and has he thought 
very deeply about the problem? The NIMH approach of pre-submission 
dialogue may be somewhat effective, but it seems rather weak. A more power- 
ful inducement might be a small grant or a consultation contract for a 
few thousand dollars to explore the need area in depth, review the | 
literature and visit a few sites to get a "feel" for what is really * 

going "on . TKe" ~gT~an t ee wou hi— tiren -b^--r«^i±rr-e^ -t-e--s^bm^-t— a--m4^^ , 

on his diagnosis prior to being awarded the grant for the larger 
project. 

Z. Require Specification of DSU Program in R&d| Proposal s [improvement Option 

Of special importance to the DSU unit might be a requirement in 
all research and development proposals thai specific plans be spelled 
out for- market i ng , dissemination, and utilization of the final report 
or product. Such a requirement is already operational in SRS" but re- 
sults on effectiveness of the approach are not in. 

There are a number of reasons pr'^ '-^'^H concerning this. Idea. On the plus 
side at least four points can be mad., vl) It might force a greater 
awareness of and sensitivity to DSU issues on the part of the R&D 
contractors and grantees. Simply by going through the exercise of 
considering audiences, media, form of presentation, time and place of 
presentation, implementation, and inducing behavioral changes, the 
RsD person would become more aware of the variables involved, the com- 
plexity, and the greater social context in which his output must find 
its way. (2) It might generate new ideas for the government on, strate- 
gies and tactics of DSU, new conference formats, new. audiences , new 
media and media forms, etc. This outcome would depend on R&D personnel 
taking more than a perfunctory approach to the mandate. (3) The flood a 
of DsU plans from individual projects at the proposal and funding stage 1 
would give the DsU unit considerable advance information for planning . 
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integration and support "of DSU l-k years hence. This assumes that the 
".plans are meaningfu-1 and realistic and that the D&U unit would have 
complete access to- them. (^0 Lastly^ such a procedure might actual ly 
increase the speed and amount of dissemination and utilization which 
takes place. We are still rather ignorant about ^'natural'' diffusion 
patterns, i.e., the extent to which new knowledge diffuses simply due 
to i^ncent i ves and Instillations olready present in the society without 
any delit)erate ei'fort by government to push D&U. It is reasonable to 
supp(^se, however, that special planning and effort expended in this 
df^rection does have some additional effects over what occurs natural ly. 

Several disadvantages to the D^U plan requirement are also evident. 
( 1.) Not all R&D products are'equally worthy of the widest dissemination. 
If they are poorly done or ^ead to iSo useful outcomes, D&U planning 
might best be directed toward a dignified burial. Encouraging or forcing 
a DSU plan in advance might raise expectations and get a ball rolling 
which shouldn't roll at alt, (2) Even' for worthy products the appropriate- 

/channels and means for D&U may not be evident in advance. In the course 
of a project various types bf linkages are created and opportunities for 
D&U, laid bare which the investigator cauld not have been aware of initially 
This- is especially true ^or young i n\jtest i gators who areiuilding a reputa- 
tion. (3) Even nnore problematic is the question of the investigator's 
expertise -as a disseminator and utilization consultant as distinct from his 
expertise -in resear^ch and/or development. D&U, rn- our view, implies an 
entirely different set of knowledge, skills, and attitudes! Therefore, 
while tfie' DSU plan mandate might recruit (or s^ubvert) RSD persons 
to fin the OSU function (where we have a 'distinct manpower defi ci t) 
rhe "assumption that evfery- jre.searcher can the reby be transformed Into 
a D&U specialists !s faulty. The federaf DSU un 1 1 might be s-tuek 
with a lot of bad pfans drafted by disinterested or incompetent in- 
vestigators and some of these plans might actually be carried out! 

Alternatively, rather than involving themselves in the exercise, 
many reseaf'chers may prefer tc ^'hire'' DSU experts onto their staffs 
for proposal writing*, wi thout 1 ea rn i ng anything themselves, or inte- 
grating the concepts in their research, (5) Finally,- the rrost te^lling 

• a rguiTiept against a spec'fic D&U plan marijdate centers on t.he question of 
efficiency and cos t-ef feet i veness . There is tremendous waste in plan- ^ 
ning a separate D&U strategy for every single R&O product. The very 
existence of a federai D&U unit implies the need for coordination and 
centralization of at least part of the effort. 



In sum, it would seem that the government should move cautiously 
,in this area. If specific DsU plans are viewed as essential at the " . 
beginning, there should also be va r1 bus ^means to provide guidance to 
the investigator on questions sucl^ as appropriate media, access to 
audiences, and perhaps a I te rnat I veV s t ra teg i es of change and knowledge 
utilization. .Such planning should also be informed by an understanding 
of the federal agency's^ total DSU program, strategy and philosophy; 
and should be cast in such a way that combining and coordinating with 
other D&U efforts is not difficult. 
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3. Ask Researchers to Write and Prepare Output for Non-Research 



Aud iences [Improvement Option #9] 



While there are many arguments against assigning complete D&U 
responsibilities to researchers, there is a strong argument for in- 
volving them in some ways, particularly in certain writing tasks and 
in deriving imp] icat ions for various users. By tradition researchers 
(but not developers) prepare their output primarily for othex. researchers 
and do not spend. much time writing for non- researchers who Could make 
use of their findings. It would se^m that all researchers should be 
requi red at a minimum to spel Lout the impl icat ions of thei r findings 
for policy makers, practitioners, administrators, the general public, 
and the client yroups in the need area concerned. 

There are at least three important reasons for imposing such a 
requirement. In the first place, researchers should become more skilled 
in commun'i cat ion oijtside their specialty particularly to user audiences. 
In almost all cases', such practice will be of benefit not only in im- 
proving the capacity for l.i nkage wi th i n the macrosystem but,for the 
researchers themselves, in achieving greater recognition and more sympathy 
from those who have grant money- to dispense. 

A second reason for researcher involvement is their expertise. No 
one has a better gras,p' of the essent ial meaning and limits of a research 
project than the investigator himself. Hence, if he is not thoroughly 
probed at or near the end' of his project, a great deal of the key Infor- 
mation will be forever buried. or revealed only by the digging of the 
most persistent and thorough scholars. 



A third reason is \h,e great need to improve the' capac i ty of all 
members of the problem-sd'lvi.ng macrosystem in deriving implications for 
act ion from research.. This is not simple or self-evident task* A 
good research report on a significant problem area, whether 'it is in- 
tentionally descr ipt Fve or prescri pt ive will contain a multitude of 
impl ications for all the persons in the' society who must relate to 
that problem including high level pol i^cy makers, practitioners, other 
researchers and consumer-clients. 'Usually a good research report will 
have something to say about the definition of the problem or the needj 
underlying causes j potential atterhatiiye solutions j and persons who 
might bie able to assist in building solutions, choosing among them, 
disseminating them, or implementing them. .Of course, in inost cases, 
these implications will not 'be obvious or exp I ici t ; they need to be 
drawn out,. It is also true that some inferences may go -hey on d the 
data at hand or-^may be only inklings or suspicions. Nevertheless, they 
increase our capacity to think about the'problem constructively and rationally 

SqueeziiH'g implications ouf'of data is not necessarily something 
the average researcher is trained to do or likes to do. Many are » 
trained to be i^ery pautious about drawing any inferences which cannot 
be supported s ta't j s t i,,ea 1 ly vyith specific data. This is the appropriate 
stance for a sGf^ntis'.t to, tak^ lespecially when his prinie concern is 
building a sound ,.varsir?.fi -'and* te/iajDle body of knowledge. But for those ^ 

/ ;■ 

' '^.'^ ■ 
' -322- , , * 



who must act within hourSs, days, or weeks, regardless of the soundness 
of tfye avai^lable data, a hunch based loosely on research is better than 
a hunch based on nothing at a 1 1 . ^. 'Researchers must come to accept and 
appreciate that fact, and within such a context they should learn to 
be as helpful as they can possibly be. 



/ 



Transform Researchers into Disseminators [Improvement Option #10] 




Any researcher who also teaches courses in his specialty is already 
a disseminator, whether he recognizes it or not; yet most R&D personnel 
' do far less disseminating than they are capable of and provide far less 
help in utilization and implementation among users than is needed and 
than they have the capacity to deliver. 

As D&U functions assume greater significance in the thinking of 
government planners and decision-makers, as we believe they will do 
continuously through the next decade, there will come a growing recogni- 
tion of severe manpower shortages in the D&U area. For every basic 
researcher, applied researcher, and developer in a given social problem 
domain there should be at least one disseminator and one utilization 
specialist. The ratio in the field of agriculture where a fully developed 
D&U network already exists is at least that great. 

* It is obvious that not all researchers are going to make good D&U 
specialists, and for that reason a blanket policy of forcing investigators 
to undertake D&U activities for their projects should never be used. But 
the D&U unit should survey R&D investigators for signs of talent and 
motivation to invest in D&U. 

To support such a trend, the'D&U unit should make available 
special kinds of training, consultation, and materials (e.g., guides 
on D&U process). There is available experience on all these matters 
among the four agencies studied which could be shared. 

5. Vitalizing and Routinizing a Buddy System [improvement Option IfW] 

The Manpower D&U unit is unique atpong all agencies we have 
studied in this project or elsewhere in initiating a one-on-one 
^ partnership between project officers in R&D and "D&U. The "buddy 

system" as a concept seems to have much to recommend it. ° It incorpor- 
ates the idea of continuous monitoring for O&U potential throughout 
the life of a project. It also divides the labor and the responsi- 
bility for different functions in a rational way while allowing for 
continuous dialogue and mutual influence between research concerns 
and utilization concerns. 

^ . ' . 

Where are problems, however. In the first place a one-on-one 
approach in which two project officers are assigned to a 
single project is a luxury most D&U units will not be able to afford. 
Secondly, the system applies only to relations within the federal 
agency^s RDD&U monitoring units; there are no buddies for the investi- 
gators, themselves (and to provide them would be insuperably expensive 
and complicated). Thirdly, there are some intimations that the MA 
buddy system has been hard to maintain over a period of years, and that 
O „ it has fallen into disuse in recent times. 
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Because of the promise of this innovation in D&U management, we 
feel that ways should be found to refine it and insure its continuance. 
A first step in this direction would be the tentative specification 
of a protocol for project monitoring which indicates the various 
points at which (a) input is required on D&U from contractors, (b) when 
revj^ew^ and sign off is required by D&U monitor, (c) where dialogue 
between research monitor and D&U monitor Is required, and (d) where 
conferencing among all parties is required. We would add the word 
"tentative" because a first fix on this rout i n i zat ion formula would 
probably be over-elaborate in some areas while missing other essentials. 

It would also seem desirable to extend the notion of the DSU 
"buddy" beyond the federal monitoring function to the projects, them- 
selves. Ways should be found to bring together research investigators 
with D&U specialists from the same or different organizations early 
in the life of a project with specific agreement on both sides that 
they will work cooperatively through the D&U phases. Such approaches 
should be tried first only on a pilot basis with one or two projects 
and the collaboration effort should be evaluated carefully (perhaps 
by a third contractor) to determine feasibility and cost effectiveness 
of this procedure or variations on it. 

We might also suggest that the model of D&U functions contained 
in this report forms one basis for constructing a routinized monitoring 
checklist for such experiments with the "buddy system." 

6. Supporting Research on D&U [improvement Option #12] 

The special brand of research, basic and applied, dealing with 
questions of research d i ssemi nat i on , . ur i 1 i zat i on , and the transfer 
of social technologies is very important for planning and directing 
the future operations of federal D&U units. Yet the amount currently 
invested in such research is exceedingly limited. Part of the problem 
may be that D&U agencies are seen as distinct from research sponsoring 
agencies and therefore have no business funding research. An associated 
problem to the lack of funding is the small number of qualified re- 
searchers who specialize in this area. A heavy reliance on such a 
small group of experts is probably always unhealthy for policy-making 
f n any field. 

It is very important in funding activities of a D&U agency to 
distinguish between D&U activities and research on them. In some cases, 
it is probably true that the investigator who initiated a research pro- 
ject can also manage some of the D&U relevant to it. It is less likely 
that he can also do research or careful evaluation of that D&U effort 
in such a way as to add to our knowledge on this special subject. . ,. 

Among our four agencies, only NCEC has been able to launch a re- 
search program focused on D&U and even this h^s been ext remely limited 
and essentially a sideline to their other activities. MHSV has spon- 
sored a state-of-the-art review and two experimental D&U projects (by Glaser 
and Ross, 1971 and Fairweather, 1973) focused on two specific mental health 
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innovations. SRS has recently been limited to evaluative studies of 
its products (e.g., R&D briefs) and its Research Utilization Specialist 
Program. It is our view, however, that MA has done the least of the 
four agencies in forwarding knowledce of D&U by sponsoring of such re- 
search, especially prior to the pre'- project. This is somewhat 
surprising in view of the staff size f the D&U unit in MA and their 
relatively close working relationships with the rest of the ORO. Hence, 
D&U "doctrine" in MA is largely guided by expert opinion derived from 
the experience of the experts in areas of rehabilitation, mental health, 
education, agriculture, and other fields which may have important 
differences from manpower, particularly in terms of existing norms and 
networks for information flow. Our very discrepant experiences between 
SRS and MA in the two interface conferences would seem to bear this 
out (see again the concluding statement of Chapter VI). 

D. TRANSFORMATIONS 

"Maximal D&U activities in the area of solution processing would 
include steps designed to move a valid solution idea into implementa- 
tion in a user system. Such functions as transforming knowledge 
into usable forms, t ransmi tt ing knowledge to appropriate audiences, 
and helping people to use knowledge would be subsumed under solution 
process ing."^ 

From studying these four units, we have come upon the notion that there 
is no such thing as a "final" product of R&D. Rather from any one R&D pro- 
ject may emanate a chain of knowledge products somewhat analoguous to the food 
processing chain; following such an analogy we can imagine a. project as acquiring 
and creating various elements of knowledge just as plants and livestock 
acquire various minerals and proteins in the process of growing. The total 
"product" in its fully grown form is rarely directly edible but must be cut 
up, processed, refined, blended with other products, and repackaged even before it 
reaches its "ultimate desti nation," the consumer. However, even the consumer must 
then prepare it, cook it, and serve it. Once received at the mputh, the food then 
goes through another elaborate transformation in which it is shredded and decomposed 
into separate mineral and protein elements to be "finally" absorbed into the blood. 
It is very important, in our opinion, for D&U units to develop a similar 
conception and appreciation of the complexities of knowledge t rans format i 6ns . 
Each of the units studied has struggled mightily, indeed devoted most of their 
energies to the transformation problem, and rightly so. What may be lacking, 
however, is an overall conception of the pattern of necessary and desirable 
trans forma t i ons . 

"Necessary" and "desirable" are extremely important words to keep in mind 
and to keep separate in viewing the transformation problem. Because the 
number of transformations is potentially so vast, the D&U unit must have 
clearly In mind what constitute the minimal necessary transformations for 
which they are responsible and for which they can reasonably be held 
responsible. This usually seems to include r,omp screening for quality 

some coj lection, some summarization, i'ioma indexing, and some tailoring for 



*This summary from Chapter IV applies to the next three sections, "T 
formation," "Transmission," and "User Helping.*' 
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specific users. Hopefully, many of these tasks will be undertaken as a matter 
of course by other units or by the researchers, themselves. Summarization 
for example is usually a routine aspeci of report writing although we find many 
D&U units being forced to rewrite or substitute new summaries in new formats. 
Nevertheless, the federal DSU unit under the best conditions should function 
primarily as a watchdog on the transformation process, monitoring and surveying 
the transformation chain at critical points, and assisting, encouraging, and 
coordinating transformations done by others. 

On the other hand, there are some audiences which many D&U agencies feel 
are extremely high priority for one reason or another. These are usually 
policy makers within the larger agency who have some degree of authority and 
policy control over the D&U unit, itself. In these cases some of the units 
attempt to provide highly tailored, summarized and packaged information capsules 
under the label of **R&D briefs." It seems clear that most D&U units will con- 
tinue to serve this highly targetted and specialized information-handling task 
in addition to their broader function of serving the pract i tioner^^j^oqimuni ty as 
a whole. 




After reviewing the many different types of informationMrfans format ion 
activity performed by the four different agencies, we would propose four activi- 
ties of particular importance to the Manpower D&U unit^but of gerjeral importance 
in providing D&U services. \ ' 

] . A Comprehensive Resource Information Center and Library Service 
[ Improvement Option #13] 

Only one of the four units studied, the NCEC, has attempted to create 
a comprehensive one-stop R&D information center and service sys tem (ERI C) . 
While this system has many problems and has been expensive to set up, it 
does provide the necessary minimum col lection and indexing activity upon 
which many other transformation activities can be built. 

In our view the D&U unit must insure that comprehensive cumulative 
collection and storage of all relevant knowledge takes place and should 
require all other information products to take adequate cognizance of 
this knowledge storehouse. Increasingly in years to come, users will 
expect and requ ire i nf ormat i on products to be built on a foundation 
consisting of al 1 existing knowledge in a given field, not merely a 
partisan, partial, or happenstance sub-selection thereof. There is no 
way to provide such a base without centralizing the responsibility for 
collection and collation of the knowledge. It would appear that the 
manpower field is in special need of such a service. 

Because of the ERIC experience of nearly a decade, it should now be 
possible to design a new system for Manpower which provides the advantages 
of ERIC without many of its shortcomings. For example, it seems quite feasi* 
ble to let a contract for the clearinghouse function either to a university 
or to a professional association. On the other hand, it is important to 
include in the facility information sources such as journals and books 
which contain relevant and important R&D information which may not have 
originated with either Manpower research projects specifically or even 
U.S. government sponsored programs. It is also probably advisable at 
this point to provide such a center with a minimum of gadgetry for micro- 
forming or computer processing since very few users are oriented toward 
Q such devices in spite of their apparent cost and/or time cutting features. 
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One major unknown in the clearinghouse picture is the potential 
future role of NTIS as the super- cent ra 1 i zed government clearinghouse 
for all federally-sponsored R&D. If NTIS can prove itself as the most 
efficient s torage- ret r i eva 1 mechanism tor government reports, it cer- 
tainly should be so utilized, but it will not take the place of a 
comprehens i ve information center to service a specialized field, partic- 
ularly one such as Manpower which depends much more heavily on the social 
than the natural sciences. 

2, High Quality State-of -the-Art Summaries [improvement Option #14] 

ft is hard to over-estimate the value of a wel 1 -wr i tten , carefully 
prepared, integrative review and analysis of the research in a given 
field. Such works, wfien they appear, can become the focus of new thinking 
and the basis for more coherent presentations of the body of knowledge 
rep res en ted not only to stud en ts and other researchers but also to 
practitioners, policy makers, ahd the general public as well. In the few 
cases where such integrative summaries have been sponsored by-.a D&U unit 
and where an outstanding writer has been found, the pay-off has appeared 
to be very high. 

Admittedly, it will not be easy for a D&U unit to serve up such 
reviews on demand or even on a regular or routine basis. Nevertheless, 
a reserve fund could be set up which could be used whenever the right 
man for the right topic came into sight. 

State-of-the-art review projects should be offered with reasonably 
generous budgets to allow the individual scholar to hire a small staff 
of research assistants and to devote all or most of his own time for a 
period of at least 3 months. In return all projects should be required 
to include manual and computer searches of obvious bibliographic sources 
including NTIS and the clearinghouses responsible for the subject domain. 

Once such state-of-the-art documents are completed, and provided 
they measure up to the standard of quality desired, there should then be 
provision made not only for wide dissemination but also for further trans- 
formations into summary briefs for policy makers, handbooks for practitioners, 
feature stories for the mass media, etc. The importance of state-of- 
the-art analyses for policy makers in particular should not be under- 
rated. Too often effective communication upward is seen as providing 
fresh nuggets of fact from current researnh projects* Yet a concise 
statement which provides an entire field of research may 
actually be more helpful to the policy rHaker, may provide him with a 
context within which to understand and evaluate the ''nuggets" and may 
even serve to reorient his thinking on the topic as a whole. Some in- 
dication of the extent of the review activity underlying these summaries 
should also lend them special credibility. 

3. High Quality Policy Briefs [Improvement Option #15] 

Responses to the survey question, *'What ts the most effective way 
to insure that the knowledge produced by research actually gets put 
into use?'* frequently cited the need for highly processed, summarized, 
and targetted briefs based on research reports but clearly spelling out 
Q practice oi policy impl Jcat ions . While such pre-d igest ion is optimally 
desirable for all good reports and all audiences, it is not within the 



practical capability of any D&U agency we are aware of. However, each 
such agency usually has one audience which is h i ghest priority and this 
will usually be the policy making or planning groups in the parent agency. 

Well-done policy briefs are almost always welcomed and seem to fit 
an important need, but there are some pitfalls. First of all, they must 
be well written and thus may require the nearly full-time talents of 
a skilled staff writer. Second, they may tend to exaggerate the importance 
of one particular study out of a whole research program (see again point 
made in previous section about "nuggets**). Hence, if the findings are 
surprising or have high "gee whiz" value as attention grabbers for the 
policy people, they may fly in the face of a larger weight of (duller) 
research evidence. 
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The process of policy brief development is, in itself, a microcosm 
of the entire knowledge transformation process; hence it is an important 
process to analyze meticulously and to use q6 a means of training and 
sensitizing professionals to many key D&U issues, particularly the very 
important and usually under-rated act of deriving practical implications.'^ 

4. Development of Transformation Checklists [improvement Option #16] 

In spite of much activity in the transformation area, none of the. 
four agencies studied has a coherent policy for determining what trans- 
formations are to be undertaken and how they are to be evaluated. One 
step in this direction might be the simple act of monitoring and accounting 
what is done over the period of a year in a number of categories of trans- 
formation. In Chapter Four we identified six transformation categories 
(bas i c wr i t i ng , summarizing, collection-synthesis, tailoring. Inter- 
pretation, and screening) which could serve as a starting point. Froin 
reviewing our findings, however, we can propose a more complete listing 
of possible transformation sub-functions which could serve as a kind 
of checklist. Items for such a list might include the following: 

( 1 ) Trans lati on 

(2) Differentiation 

(3) Integration 
m) Col lection 

(.5) Simpl if ication 

(6) Ampl if ication 

(7) Recompos i tion 

(8) Summarization 

(9) Labell ing 

(10) Embel 1 ishing 

(11) Targetting and Tailoring 

(12) Redundancy cutting 

(13) Redundancy building 
{]h} Consensual validation 

(15) Screening 

(16) Print- print referenc i ng 

(17) Pr in t~ person referenci ng 

(18) I ndexing 

*See ''Operational Mode #5" described in Chapter One for one pattern^^^y which 
this activity could be organized routinely. 
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Each of these items deserves some brief comment. 



(1) Translation: Thib could refer merely to taking from one language 

and putting in another, but more broadly and importantly 
it refers to the task of renxjvlng technical terms or terms 
unfamiliar to the •probable audience and replacing them with 
familiar terms. Often what is called "jargon" is merely the 
specialized language of one audience, useful and important 
for internal communication amohg a group of specialists. 
Nevertheless, the same words wKich would assist communication 
among the in-group, may block communication across groups. 
It does not always follow, however, that strange words 
should be eliminated. There may be times when a new word 
is necessary to introduce and stand for a new concept. It 
may also be true, on occas ion, that a few new words add to 
the sense of novelty and interest-value to a sophisticated 
audience. The question for the translator, therefore, is how 
much is too much for the intended audience. 

(2) Differentiation: Sometimes a piece of writing in its original 

form will be too massive and unapproachable for many readers 
until it is broken down into segments that make sense as units 
within the whole. Most report writers at least have enough 
concern for readers to segment their material into "chapters," 
but this may not be enough for many readers* Any work should 
be seen as a whole constructed of separate but logically 
related parrs. Clearly identifying the parts allows the 
reader to enter the material in more places, choosing his 
starting point at fa^^Miar, novel, or otherwise salient 
segments . 

Another aspect of differentiation is showing or explain- 
ing how and why a particular piece of work is different from 
other work or past work that* may seem very similar to many * 
readers. This type of differentiating allows the busy reader 
to decide whether or not the new item will add enough new 
knowledge to be worth the time and trouble of reading. 

(3) Integration: Material may be quite well differentiated and 

unitized but the elements may not be coherently related to 
one another. A common communication error of scholars is 
assuming that readers can make their own connections mentally 
the same way that they can. In fact, making such connections 
explicit is an important aspect of good communication between 
researchers and practitioners. 

{k) Collection: As noted in Chapter Four, simply bringing items of 
knowledge from different sources together is an important 
transformation function which is recognized by most units. 
Special collections clustered and keyed to practitioners' 
needs, concerns, and terminology are probably the most relevant- 
types of collection activity for a D&U unit, and may have to 
be carried on in addition to and parallel to the massive 'and 
^ centralized archiving of, knowledge by an agency such as NTIS» 
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(5) SimplifiaaHon: In addition to removing strange technical terms 

in translation, it may sometimes be necessary to reduce a 
complex and sophisticated analysis to something that is 
comprehensible to the layman. Metaphor Is a most common vehicle 
for this (as, for example, In our food processing chain analogy 
for the transformation chain earlier In this section). Scholars 
are fearful of distortion and misrepresentation in this process 
and are often very reluctant to engage in attempts to simplify 
things that seem perfectly simple and obvious to themselves 
already. Hence, th^ task often falls to journalists or non- 
specialists who may be more prone to make the viery errors 
that scholars fear. 

(6) Amplification: While outsiders may often get the impression that 

scholars are excessively verbose and encumbered by an excess 
baggage of elaborate terminology, the reverse may be the 
problem for cross-disciplinary communication. Scientific 
comma n i cat i on wi thi n a d i sc ipl ine, when it is worki ng wel 1 , 
takes place in a kind of short-hand in which a single word 
may stand for a whole cluster of concepts well understood by 
the communicator and the special audience of colleagues that 
he comes about the most. Hence, external communication may 
require aciding many paragraphs of explanation, background 
filling, and context setting for the non- i n i t i ated - 

(7) Recomposition: Report writers do not always put material together 

in ways that assist the reader in access and in building 
involvement. "Order effects are extremely important in cross- 
discipline communication; the first chapter, for example, 
should always include both a sumrifiary and a sampling of the 
the most interesting findings if the writer really wants the 
reade/ to go on beyond it. Recomposition may not involve any 
rewriting at all; merely a reordering of sections and the 
relegation of some things to appendices can have a salutary 
affect. The original writer is not always the best judge of 
what should go where for optimal readability^ 

(8) Swmavization : This point is well-covered in Chapter 4, Section 4<12. 

(9) Labelling : Related to >f tem #2 above is the need for adequate 

and accurate labeling of sections or elements of reports so 
that busy reade rsSwi-Irk get some impression from rapid scanning 
without being misled, ^ven a one-word heading is a summary 
and it is rarely true tm^t every sentence in a report is of 
equal value and interest to all readers- Hence, good headline 
writing is a crucial type of transformation. 

(10) Embellishing: Research reports can be unpalatable for a variety of 
reasons, not the least of which is dryness and abstractness of 
style.. Often the aspects of a study most likely to arouse and 
/ sustain reader interest are the verbatim statements of respon- 

' dents or descriptions of actual situations which the researcher 

relegates to his files, having collated, tabulated and abstracted 
the essential factual content. Human interest anecdotes may 
add nothing whatever to the validity or substance of a report 
K.it th^y can be crucial for broader communication particularly 
to the public, to congressional committees, etc- 
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Examples from the data with verbatim statements and/or 
photographs represent one form of embellishment that is re- 
latively harmless and beneficial. Another form rarely indulged 
by researchers is hianov. Often a point can be punctuated with 
' a joke or a cartoon without too much distraction. 

Finally embellishment may also come by tying in a finding 
with a specific example or situation drawn not necessarily from 
the research data but from everyday experience familiar to 
the particular audience. This is prc^ably the most important 
form of embellishment and can only be done by someone very 
familiar both with the research and with the circumstances of 
the audience in question. 

I 

(11) Targetting and Tailoring: With the last point above we move to the 

very important matter of deriving special implications for 
action for users in partt^cialar situations.^ At the most specific 
level It is difficult an'd perhaps even^i rresponsible to suggest 
actions based on research without personal discussions with 
the particular users about the particular problems they face 
(a "user helping" activity within the schema of Chapter k) . 
i Nevertheless a considerable amount of interpretive work can* 

be undertaken as illustrated in Chapter ^, Sections h.]k and 
4.15. We would stress the potentially high cost of this acti- 
vity and therefore the importance of three guidelines: (a) tailor 
only for clearly defined highest priority audiences; (b) when 
tailoring is done make sure it is done well by someone with 
demons t rated wr i ti ng skills; and (c) train researchers and 
practitioners to do their own tailoring. 

(12) Redundancy Cutting 

and 

(13) Redundancy Building: Complaints about over-long reports often 

center on the question of redundancy, either that report 
says the same thing over and over again or says t e same 
thing as another report. Such redundancies no doubt call 
for cutting and perhaps even shelving certain reports with- 
out dissemination. On the other hand redundancy as such 
is a necessary feature of both scientific Inquiry and effec- 
tive communication. It is important for basic knowledge 
building that important findings be confirmed by different 
investigators using similar and different methodologies* 
Hence a new study which confirms findings from prior re- 
search may be important unless it is another of many to 
show essentially the same thing. 

The very terseness of a report may sometimes hinder 
effective transfers simply because fast busy readers will 
miss or underrate important points which are stated ohly 
or^ce. Important points also need to be stated and restated 
in different words with or without embellishments to increase 
the^probab i 1 i ty that they wi 1 1 fit the idiosyncratic reading 
styles and tastes of a predictably broad range of readers. 
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The essential point here is cleternTt n ing and writing for 
J^st that degree of redundancy necessary to clarify the message 
over the "noise" of jargon and dissimilar interests and situations 
and n£ more . 

(H) Consensual Validati.^n: On rare occasions the credibility of a 

report can be enhanced oy obtaining judgments from e>iperts, ' 
representative readers, or VIP's of various sorts and re- 
porting these judgments as a kind of endorsement. Such a 
procedure might of course militate agaTnst controversial 
reports which produce surprising findings, but this depends 
on the type of judgment called for, e.g., a panel of methodolo- 
gists might merely affirm that the procedure followed con- 
firmed to the highest standards of scientific method. The 
National Center for Educational Communication in effect 
followed such a procedure in the Educational Testing Service 
project evaluating R6D products of labs antl centers. 

(15) Screening: This topic is adequately discussed under Chapter 

Section ^.16. Each of the four D&U units studied ha^ attempted 
some form of screening for quality and/or relevance-. Until 
very recent times the stringency of screening has increased 
as a function of the increasing volume of mater i'al produced on 
a given topic; one important aspect of the information handling 
technology introduced by ERIC, however, is that it allows an 
enormous volume of input into the system without much screening 
by anyone but the user. Tfiis means user self-screening for 
relevance can be extrem.ely high (provided there is a good 
thesaurus and he knows how to use it), but the scientific quality 
question is by-passed. Such a system might well serve the needs 
of practitioners better than scholars. 

(16) Print-Print Referencing : Usually academic researchers are rather 

good about making reference to past work by others but not 
all researchers are good at this and developers and applied 
researchers in non-university settings (where publication 
rewards are less) are generally rather poor at it. Compound- 
ing the p rob 1 em is the government R&D mon i tor ' s ret i cence 
because in most cases he Is not himself thoroughly versed in 
the literature and is reluctant to reveal his own ignorance. 
Nevertheless, pr i nt- to-pr i n^ referencing is very important 
in buildingta sound fabric of knowledge and allowing highly 
interested rfeJ^ers to pursue an area to the maximum depth 
possible. 

(17) Print-Person Referencing may occur automatically alongside print- 

to-print but useful references can also be made to people 
working in a given area, particularly with current projects 
where no reports arc yet ava:!abie but where a reader can 
be linked to a valuable resource person. The contract 
monitor is often in the very best position to know who^^'such 
persons are and should take every opportunity to bring R&D 
works together and i-o get them to cite each other. This Is 
how communication nr^i/vorks come into being. 
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(18) Indexing^ Finally, we find a deplorable number of government re- 



ports which lack indexes and are thus totally inaccessible 
to the reader searching for specific information beyond that 
contained in the title or -abstract We can find no suitable 
explanation for this lapse except that it may signify the lack 
of importance that the researcher places on a report as distinct 
from a published book. The fact remains that an unindexed book 
demands of the user either that he scan the table of contents 
with hope, that he read the entire contents, or that he not 
read at all and hope that nothing on his topic was said. 

It seems entirely appropriate that important reports 
be tagged as requiring indexing either as part of the cost 
of production or as a separate action supported after screen- 
ing. This would also be a necessary first step toward a truly 
compreh .r.s i ve information retrieval system for a topic area. 



5 • Decision and Product Archiving 

Transformation is hard work. Many decisions (for example, the 
best way to tailor for an audience) or comments of clients or staff 
must be saved as a reference for future similar situations. (This 
point also applies to transmissions.) 

^E. TRANSMISSIONS ' ^ ^ 

We were surprised to find that among our four D&U units much more effort 
and resources seemed to be invested in transformations than in transmi ss i(^s , 
but this ci rcumstance a rose from different factors in different agencies. 
In NIMH, for example, private sector professional channels are considered to 
be quite good, supported by an extensive network of professional journal's and 
conferences with i nterd i sc i p 1 i na ry over 1 app i ag memberships. In education 



as inadequate, hence the creation of fRIC and more recently the pilot phase 
of an extension service based in sta^te education agei-scies. In Manpower the 
^problem se'ems to be different, however; the professional networks are some- 
what weaker and more diffuse than in either education or mental health, and 
may not be the best vehicle for reaching state and local agency **p^rsonnel 
for whom material has the highest practical relevance. At the same time 
direct access to these users by the DSU unit is apparently inhibited Sy 
their status within the bureaucratic structure of the Manpower Administration 
and by norms of non-interference at the state level. We believe that these 
problems are \not insurmountable, however p^^aadj would propose five steps in 
that di rect ion. 



both professional 




upon but are recognized 



*Even a highly rated report such as Breakthrough for Disadvantaged Youth lacks 
an Index as does the prestigious Manpower Report of the President. 
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1. Maxtmize R&D Input to Existing Organs [Improvement Option #17] 



At least two very fine d i ssemi nat ion' charine 1 s already exist in the 
Manpower Administration in the form of the monthly magazine Manpower and 
the annual Manpower Report of the P,resident . These publications are 
available tb and received by a large proportion of relevant manpower 
users, particularly at the federal level. Therefore as a first guide- 
line to transmission pol icy^ the D&U unit should make every effort to 



i ncrease«sR&0 input to these organs and to Insure that such input is 
hiflh quairty with high reader appeal and with action implications as 
clearly spelled out as possible. 



To greatly increase R&D input to these organs i t may also be 
necessary to improve internal interpersonal linkages between the responsi- 
ble editors and other ORO staff involved in project monitoring. Assuming 
a very close collaboration rel at ionsh i Pj i t may also be possible to use 
one or the other of these publications as part of experimental diffusion 
effort^ with 'ollow-up and more specific counselling on utilization with 
various users. 

Da i Vy Newsletter for Policy Makers and Administrators [Improvement 

#r5T 
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Some years ago a number of the MA staff initiated a daily news- 
sheet cons i st i ng of xeroxed newspaper clippings of items of special 
interest. Although the newsheet was popular and widely read it fell 
into disuse in recent years. For a variety of reasons it would appear 
to be dWsirable to revive this idea, casting it in a slightly different 
form anci greatly increasing R&D inputs in addition to news items from 
other sources. 

\ ■■ ' ■ 

It IS a well-knoWn fact that newspapers are a primary medium for 
recei ving^Jpformat ion orl a daily basis for all government officials . 
and representatives from the President on down. It is therefore worth 
considering how important aspects of the newspaper as a disseminat i^oh 
device could be incorporated into a special organ of the Manpower D&U 
unit. Four aspects stand out:' regularity, brevity, scanabFlity, and 
variety. .1* 

(a) Regularity: Channel ^''^nsist be used regularly to be really 

effective; they must build .and maintain the habit of 
use in the audience. For this reason, a daily sheet 
is probably more effective than a weekly or a monthly sheet . 

(b) Brevity^' Almost as a corollary to (l), a newsheet cannot entail 

much time to read or to prepare. It should not inter- 
fere too much with the routine work patterns of busy 
administrators and it cannot place too great a burden 
on D&U staffers at least until it proves itself as a 
valuable addition to the program. 

(c) Soanability : The entire contents of the newsheet should 

be easily scanable in less than two minutes^ and to 
this and should be carefully and clearly headlined 
very much like newspaper. 
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(d) Variety: To appeal to a variety of^reader interests and 
needs the newsheet should include news notes from a 
variety of sources broadly relevant . to manpower issues, 
always including some RSD content bu€ rarely if ^er 
exclusively. 

Whereas the newsheet might be'sjmilar to a. news- 
paper in, many ways it ought to be'tiifferent in others, 
particularly if the goals of the D&U u|iit-'^o beyond, 
mere transmission of i nforma^t i on . First of all, all 
R&D inputs should be clearly referenced wi th information 
included on access and acquisition. In fact, for selected 
high priority users, - each issue of the newsheet should 
inclyde some sort -of order b1 ank wh ich serves*^o (l) makes 
access to detailed information .easier and /aster, and' 
(2) implants the idea that furtfier pursuit of a topic 
might sometimes be appropriate. as well as possible. 



3. Fast Turn-Around.Reference Servil:e for Policy Makers [Improvement Option #19 

While the newsheet would^have high' value as a transmission medium \ 
to policy makers, it wou.ld -not alone t?e sufficient to improve D&U services 
to that audience. In addition, we would propose a rapi d response per- 
sonalized search and retrieval -servi ce for selected persons at high levels, 
or to a few users atVa-rious times on an experimental basis. .'Each such 
user should be thorough.ly briefed on -the purpose and capability of - the ^ 
service, and his informat,Jon needs carefully anrd individually proflj'ed in 
detail. This concept has been elaborated in two^. rather different 
ways as Operational Modes #4 and-^^ in 'Chapter One. 

4. Farm Out the Dissemination-to-Research and 0.1 sseminat ion-to'Pract i ce 
Funct i ons [Improvement Option #20] 

For a variety of reasons i.t i's probably advisable to decentralize 
\ or at least de-federa} ize most dissemination and network building functions, 
leaving the D&U unit rn the role of a supporter , 'coord i nato.r , and in some 
sense, a monitor. This has been done rather successfully by NCEC in 
the ERIC system. I ntervi ews* wF th the staff librarian i,n the Manpower 
D&U unit indicate that a large proportion of requests for reports come 
from univers>4ty sources; vWhile such servicing of the academic community 
may be important, it could probably be done more efficiently under con- 
tract to an ER'IC-type clearinghouse as^well as through referral to NTIS. 

/ The main reason fpr such a shift woyld be to allow concentration 
of stpff resources on highest priority and highest proximity users, 
especially in policy and planning, and to permit experimental attempts ^ 
to provide intensive high ly-targetted and use-centered experimental 
dissemination projects. ^ ^> ^ • . " • 

5. Tie, Into and Strengthen Existing Knoijle-dge Networks [ I mprovjement Option il]] 

The purpose of the pbove shift in D&U policy would hot be to , ' 
deemphasize or downgrade the imparta^'nce of D&.U for practitioners but 
rather to improve it, particularly in light of the current pattern o'f 
Q communication suggested in the "network'' Fbgures on pages ^^-9 and 5*10. 
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What appears to be a nrost promising approach is the s'o-called 
strategy of "utilization by subversion*' already practiced to a limited 
extent by the Manpower DsU unit. Existing networks, professional 
association meetings, and journals should be encouraged and supported 
through continuing contracts to translate, interpret^ and disseminate 
RSD f ind i ngs, ' - 

Of special importance might be the support of a professional 
association to begin an annual series of conferences with put^lished 
proceedings on a topic of special and continuing Importance fto manpower 
workers. Such a ' conference ' ser i es should be deliberately plairned to 
include participation by practitioners and government official^as well 
as university and private sector researchers &nd developers^-'^ch 
annual events can be designed to act sy ne rg i s t i cal 1y in 5^e/ving many 
purposes thrqugh combining many kinds of input, forrnal ana informal, 
print and personal. They can focus publ ic ity and concern on a topic, 
build an interdisciplinary researcher-and*"practi tione,r network, assist 
In summarizing and synthesizing existing knowledge, and provide important 
motivational and intellectual stimulation for further work on sub-topics 
of +iighest priority and interest. 

F. USER-HELPING 

While transmission priorities, m^ans, and costs are reasonably clear and 
calculable, the same is by no means true for the more challenging c^pd ulti- 
mately more important function of user helping. We find all four DSU units 
groping for new and creative directions i n- th i s ' a rea , and our current survey 
does not reveal too many imaginative strategies that are clearly. to be 
recommended. In essence, we feel that more basic knpwle^dge Should be 
generated regarding knowledge utilization activity at a very concrete behavioral 
level. As a corollary to this, attempts to provide user helping services should 
be designed as experiments so that v/e can learn with more certainty what works 
and wha\ doesn't work, and what benefits can he achieved for what costs. 

■ ' 

D&U Specjal ists r Improvement Option #22] • . 

Both SRS and OE have conducted pilot projects to recruit, train, \ 
and Install research utilization specialists in state agencies. Both ' 
projects . showed some promise^ showed that it could be- done, showed * 
that agents performed useful services for some, clients and coutd sur- 
vive for a period of time with federal support w i thout hav ing these 
funct ions'' subverted by other forces afid .priori ties acting within the 
statie bureaucracy. The repolrts on the experience td dap^]-ea\/e. 

unanswered two quest i ons of /highest importance: ( 1) cfltfT^^'^^gent ' \ 

provide personalized user hilp to enough people to have aVi impact 

proportional to his cost? andX2) can an agent survive over the lohp ^ 

haul still maintaini^ng his ynker rolew^'th or without continuing 

federal support? ^ . ; 

Thorough evaluations of both the SRS^and NdEC extension agent 
^ • projects .a re now underway and may provide satisfactory answers to" ^ * 
j these- quest ions. The .SRS agents are being evaluated by Edward Glaser 
Associates, and the NCEC agents are being evaluated in the National 
'Institute of Education contract wi th 'Stanford University which stresses 
^ cost and quantitative benefit factors. Results of 'both "these studies 
should be awaited and examined closely before major new' initiatives 
are undertaken in this area.^ -336- 



2. Adapt or Redevelop RU Manuals [Improvement Optfon #23] 



Both NCEC and NIMH have developed research utilization manuals 
and handbooks of various sorts, and these have been acclaimed by many 
users. If such manuals are effective, they represent in some sense a 
very low cost alternative to the creation and installation of RU 
specialists. Yet there are no equivalent products available in the 
•manpower field to provide this specific kind of i nf o rmat i on . With a 
small inves'tment, existing manuals f rom educat i on , mental health, or 
elsewhere could be adopted with the inclusion of case examples 
specifically relevant to typical manpower problems. There may also 
be RU factors unique to the manpower area which would require more 
extensive redevelopment or targetting of such manuals. 

3. Changing Attitudes Toward Research Utilization by Practitioners 
[Improvement Option #2^J 

Part of the utilization problem may be motivational; potential 
users may never have had successful experiences either in personal 
e.TCOunters with researQhers or in attempt^s to read, i nterpret , and 
apply information from research reports. Attitudes can be changed, 
however, through demonstration of applications to practical everyday 
situations as well as by constant reminders and suggestions on the 
value and relevance of research supported by convincing real-life 
examples. Ooe element that often seems lacking perhaps particularly 
in the Manpower field is the belief on the part of the practitioner 
that R&D is relevant to him and worth the effort it takes to read 
and deri.ve his own action implications. 

Training in RU for Practitioners [Improvement Option #25] 

Related to"the prev ious po int is the need for widespread training 
in specific RU skills such' as defining needs and objectives, identify- 
ing and retrieving relevant research, evaluation and interpretation 
of research, deriving implications for alternative actions, and design- 
trig, trying out, and evaluating changes based on research implications. 
Some program packages for such training are available in education- 
and could probably be adapted for use with manpower professionals. 
Manuals such as those mentioned earlier can also be used as a basis 
for such training. 

\5- RU Services in Crisis Situations [improvement Option #26] 

The surveys reported in Chapter Five include replies to a question 
concerning information use in crisis situations. A principal finding 
is that research information is rarely sought in such situations, a 
sad reflection on current levels of research utilization. It would seem 



'^For example, Charles Jung's Resource. Utilizing and Problem-Solving (RUPS) , 
a process training package for teachers, Northwest Regional Educational 
Laboratory, Portland, Oregon, I970. 
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appropriate, therefore, to initiate in depth analyses of crises within 

the agency and for practitioners, followed by some specialized services on a trail 

experimental basis to reach out to users in crisis to assist them in 

retrieving pieces of research very relevant to their needs, to further 

assist in deriving implications, planning implementation, etc. Such 

services could be provided on a "hot line" arrangement, perhaps similar 

to one now in use in the Congressional Research Service of the Library 

of Congress. Such a service would require a good deal of preparation 

including a prior assessment of the kinds of questions most likely to 

be asked and the kinds of crises most likely to be faced. 

Chapter Five showed that informational crises in the agencies often 
involved requests from high policy makers or Congress. An "on-call" service 
geared to making available RSD information in these s i tuat ions (through 
retrieval systems and/or experts) might be developed and tested to help 
in such crises. 



Each call for help and its consequent service giving and receiving 
activity should also be carefully documented, probably by a third party 
both to rate the adequacy and value of the service provided and to under- 
stand more clearly how such a service can be organized for maximum per- 
formance. In this way we might get a better understanding of the dynamics 
of user helping and assess the extent to which the D5U agency must reach 
out to he!p the user over and beyond what the user can do for himself. 



MICROSYSTE'^ BUILDING 




"Microsystem building refers to activities In which many 
elements of the problem-solving dialogue are simultaneously pre- 
sent and are allowed to interact on a small scale. Maximal D£U 
functions in this area would include interchanges between researchers 
or developers and users, user-collaborative R&D, and integrated 
RDD&U programs." 



\ 
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Evaluate Effectiveness of Past and Present Microsystem Projects [Improvement 
Option #27] 

A sophisticated knowledge flow system will include some activities in 
which many elements of the problem-solving dialogue are simultaneously present 
and are allowed to interact on a small scale. The importance of this 
point is underscored by the high overall use of interpersonal media 
within all groups (and between, in many cases) in the data from\the 
pilot surveys (see Chapter Five). We are of the opinion that a great deal 
of microsystem building must go on as part of an overall program to improve 
DSU and to create a national problem-solving system. However, we must , 
say this as a matter of faith and logic rather than proven assumption. One 
attraction of microsystem activities is that they are intrinsically satisfying 
to those involved and their benefits for such persons are not too difficult 
to assess. Yet the primary rationale of microsystem building in our view 
lies in its secondary or spin-off effects, e.g., (l) as a demonstration of / 
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how macrosystem DSU can take place, (2) as a training experience for researchers 
and/or practitioners which they can use subsequently themselves and pass on 
to others, and (3) as a way to build knowledge which is highly relevant for 
certain types of users and which hence can be disseminated broadly through 
transmission activities of the O&U unit. 

Yet these spin-off activities have been difficult to measure and there- 
fore the true value and cost-effectiveness of microsystem building have been 
hard to demonstrate. For this reason we feel that the priority here now is 
evaluation of past and existing efforts with emphasis on development of a 
suitable methodology for continuing evaluation. 

H, MACROSYSTEM BUILDING 

''Although most macrosystem building functions lie outside the 
domain of any particular unit within an agency, several processes 
can be identified as maximal D&U activities in this area: modelling 
of the macrosystem, monitoring of the macrosystem, promoting linkage, 
filling recognized gaps, and building system awareness." 

The role of government in the U,S. is generally not to do research or 
service directly but to hover over the complex of institutional forms which 
provide service and perform social problem-solving, attempting to serve and 
represent the general public and the general good by "coordinating" separate 
efforts. Government should see to it that RSD communities and service profes- 
sions work together with users so that they collectively function as a problem- 
solving system to the benefit of the society. 

The agencies of government can work to shape and reshape the macrosystem 
in various ways, e.g., through exerting direct control on certain individuals 
and subsystems via legal sanctions, rules and regulations, through protection 
of other individuals and subsystems, through financial support and subsidy 
of various subsystems, and through creation of new roles, institutions, and 
other facilitating mechanisms to fill recognized gaps and to help the total 
system function more effectively and beneficially. 

1. Honi tori ng [Improvement Option ^28] 

A major outcome of this project has been the development of a 
framework and a set of procedures for definition and analysis of 
probl em-solving macrosystems and the role bf federal DsU units within 
them. An important next step would be to be(Shln efforts at monitoring 
the macrosystem based on this schema or some o^:l:ter. Confusion and 
ambiguity about the scope and function of D&U unites abounds. There is 
a need to set activities in context, in relation to one another, and to 
consider them In proportion to one another as parts of^a logically inter- 
related whole. ^ 

One might ask where responsibility for such monitoring properly 
resides- It can be argued that all macrosystem factors belong at a 
level above the typical D&U unit. We agree that this is true for the 
most part provided someone in the system recognizes their responsibilities 
in this regard! The D&U unit, however, has a special mission in examining 
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the flow of cormunication especially for R&D information but not exclusive- 
ly, since through the labyrinth of transformations and transmissions what 
is ultimately R&D and what not is seldom clear. Having such a mission 
puts the D&U unit in a legitimate position to monitor the functioning 
of the total system on what might be perceived as a fairly neutral and 
non- th reaten i ng theme, the flow of R&D needs and findings. 

2. Creating a Centralized R&D Storage-Retrieval System [Improvement Option #29] 

Only one of the four agencies studied has attempted to do this in 
a thorough-going way (NCEC's ERIC). For the other three such a system is 
probably beyond their means and may not be called for because of the 
much smaller volume of research which is handled. As stated earlier 
under "t rans format i ons, " we feel that some such centralized library 
storage and cataloguing mechanism is necessary as a basis for many 
other types of transformations as well as- to provide a competent and 
comprehensive response to user requests . In view of the costs and 
uncertainties, however, it would seem desirable not to duplicate 
mechanisms that already exist elsewhere and therefore to piggyback 
when possible either on NTIS or on ERIC or both. However, although 
there is a general trend in the federal government toward using NTIS 
as a central depository, the actual operations and capability of that 
facility should be examined critically. Because NTIS functions are 
paid for by users, some types of report dissemination will be greatly 
inhibited unless ways are found to subsidize the search activities of 
these users (subsidy experiments might themselves be of great interest 
to D&U units in examining and finding ways to increase RU behavior). 
Other problems may arise from attempting to use a mechanism designed • 
for technical hard science information for codifying and handling 
social science information. 

A cataloguing and retrieval system which could contain both R&O 
and the now better-used data on performance/ description of manpower 
could provide a focal point and link to both kinds of output; for 
example, a policy maker might request latest unemployment statistics 
from the system, and get back this plus a summary on the latest re- 
• search. 

3. Building an Extension Service [improvement Option #30] 

There is no question that the most successful RU system to date 
has been the U.S. Cooperative Extension Service servicing agricultural 
producers. Does such a system make sense outside of agriculture and, 
if it does, can it be developed with the kinds of resources likely to 
be available in the next few years? The answers to both questions are 
be i ng sought i n two studies now i n progress and ment i oned p revi ous ly 
In this Chapter, and as we indicated we recommend that new actions in 
this direction should await their findings. However, on the basis of 
what we know how I think we can guess at partial answers which are a 
'qualified "yes" to applicability and "no" to cost. If this is so, it 
would seem most imprudent to begin building a system on a shoestring 
and then to expect of it the same kind of results delivered by far 
more lavishly supported efforts. 
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This chapter has contained a large number of suggestions and 
ideas about how to improve DSU systems with special reference to the 
Manpower Administration but with some applicability to all systems. 
In a real sense, however, the task of deriving such action implications 
should not and cannot be left to the research investigator alone. In 
the first place, research tends to descr\be'*what is^better than it 
describes"zJ?2at might be"; there is no guarantee of creative new ideas 
even in the highest quality research products. Secondly, deriving 
such implications should be a joint activity involving the policy 
maker, the administrator, and the practitioner at least as much and 
probably more than the researcher. Methods for bringing about such 
interchanges are sorely needed, particularly methods which encourage 
creative thought on the one hand and responsibility to the needs of 
the situation on the other. We had hoped to create such constructive 
brainstorming discussions in the interface conferences but were not 
very successful for reasons not altogether clear to us. Many suggestions 
have also come from interviews and questionnaire responses, and wherever 
appropriate we have tried to include them in our recommendat ions • 
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Center for Research on Utilizatidn of Scientific Knowledge 
Institute for Social Research 
The University of Michigan 
Ann Arbor, Michigan 



KNOWLEDGE COMMUNICATION AND UTILIZATION: An Exploratory Study 



A. Description of Primary Professional Roles, Functions, or Duties 

As a context for considering the questions which follow, we would like 
you to identify yourself in terms of the organization you belong to and the 
work you do. Since you probal^ly do many more things than can be listed in 
the space provided below, Indicate only those aspects of your job which are 
most salient to you. 

1. ^ What are your major work activities? 




Please check the group below which most closely identifies your job. (If 
more than one applies, pick the one on which you spend the greatest amount 
of time.) 



Federal 



a. Federal policy and planning staff 

b. Federal research administration staff 

c. Federal program administration staff 

d< Federal dissemination and utilization staff 

e. Federal regional office staff 



Non^ Fede ra 1 Agenc i es 

f . State agency administrative or service personnel 

g. State agency research, demonstration, or dissemination personnel 

h. Local public agency administrative or service personnel (e.g., 

city or county vocational rehabilitation centers, mayor's 

office, etc.) 

i. Local public agency research, demonstration, or dissemination 

personnel 

j. Private agency service personnel 

k. Private agency basic or applied research staff 

/ 1. Private agency demonstration, dissemination, or utilization staff 

m. University/college basic or applied research staff 

. , ; n-^-Uni vers ity/col lege demonstration, development, dissemination, 
or uti li zation staff 

o. None of the above categories applies to my work role. I would 

I would suggest the following category instead: 



B. Linkages with Other Group's 



In this section we are concerned with the important contacts you have with other 
groups. We will begin with the contacts in which you receive information from other 
groups, and later will cover those contacts in which you send information to other 
groups. 

I. Select the two groups (excluding your own) from whom you receive the most 
important information. For both of these groups, answer the following 
sets of quest ions . 

].\ FIRST GROUP (inYportant information received): 

a. Briefly identify the person, group, or organization outside your own 
group from whom you receive the most important information. If a 
person, indicate organization and role. ^ 



b. Referring to the list on page 1, enter the letter designation (a-n) 
of the group which most closely corresponds to the person or group • 
you have identified in "a** above, 

c. How frequently do you recei ve information from members of this group? 
(Cl rcle one, ) 

1 2 3 / A 5 

once a every few at leas/t at least at least 

year months once a once a once a 

month week day 

d. How do you typically get information from members of this group? 
(Choose a maximum of three ways, ranking them with a \^ for the vnost 
frequently used way, 2_ for the, second, and 3_ for the third,) 

ConVe rs a t i on Books 



JTelephone ^Conventions, professional 

meeti ngs , conferences 

_Correspondence or memos 

Abstracts, summaries 

^Reports — 

Guidelines, procedure manuals 

Journal s 



Other (speci fy) : 



e. What type of information do you typically receive from members of this 
group? (e.g., research study, evaluation, model design, performance 
data, etc.) If possible, cite specific examples of the most typical 
Information received. 



f. How do you use this information in your work? (e.g., "to design new 
program*'; "for use in budgeting", etc.) 

. J? 



!.2 SECOND GROUP (important Information received): 

a. Briefly identify the person, group, or organization outside your own 
group from whom you receive the most important information. If a 
person, indicate organization and role. ^ . - 



b. Referring to the list on page 1, enter, the letter designation (a-n) 
of the group which most closely corresponds to the person or group 
you have Identified in '*a" above. 

c. How frequently do you receive information from rnembers af-^his group? 
(Ci rcle one. ) 

1 2 3 ^ 5 - ^ ^ 

once a every few at least at least at least 
year months once a once a once a ,^ 

month week day 

d. How do you typically get information from member^ of this group? 
(Choose a maximum of three ways, ranking them with a ]^ for the'most 
frequently used way, 2^ for the second, and 3, for the third.) 

Conversation Books , 



Telephone ^Conyentions , professional 

ngs , conferences 

Correspondence or memos 



Reports 



_Lonyer 
nfr^ti r 

Abstracts , summaries 



Jburnal s 



Guidelines, procedure manuals 



_Other (speci fy) : 



What type of information do you typically receive from members of this 
group? (e.g.. , research study, evaluation, model design, performance 
data, etc.) *lf possible, cite specific examples of the most typical 
Information received. 



f. How (jo you use this information in .your work? (e.g., "to design new 
program"; "for use. in budgeting", etc-) 
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8 2., Now we wou)d like to switch our attention/ to those groups to Whom you send 

Information.' Again, choose the two most important groups (excluding your own) 
to whom you send i'nformation. 

2,1 Fl RST GROUP (important information sent): 

" *■ ' , * 
a. Briefly Identify the person/ group, or organization outside your own 
group to whom you- sencl the most <]mpprtant Information, If a person, 
^ indicate organization' and role^.- ^ 4 



Rieferring to the list^on page I, entej- the letter designation (a-n) 
'of the group which most closely corresponds to the person or group 
you have Identified In "a" above, 

How frequently do you send information to members of this group? 
(Ci rcle- one, ) 

^ ^ \ : ^ 2 ^ 3 l4 5 ' 

once a ' every .few at least at least at least 
year ^mon'ths once a once a once a 

month ^ week - day 

How do you typically send infprmation to members of this group? 
(Choose a maximum of three ways, ranking ttiem with ^a I for the most 
frequently used way, 2_ fog, the, second, and 3_ for the third,) 



^Conversation 
telephone 

Correspondence or memos 
Reports* 



Books 

Conventions , profess ibnal 



' ;^eet i ngs , conferences 
Abstracts , summaries 



Journals 



Gut del Ines , procedure ma nua Is 



Other (specify) 



e. What type of i nformat ion do you typi cal 1y' send to members of this, group? 





Tq the best of your 
group typical ly . use 


knowledge 5 for what 
the information you. 


purposes do members of this 
send to them? 

K 

o 


') . ' " - — ^ — 







g. How do yofu determine How, or to what exteni, they use the information 
you send to them? * ' , 



< 

*3 
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SECOND GROUP (Important information sent): 



Briefly Identify the person, group, or organization outside your own 
group to whom you send the most important information. If a person, 
indicate organization and role. ^ 



Referring to the list on page 1, enter the letter designation (a-n) 
of the group which most closely corresponds to the person or group 
you have identified in "a" above. 

How frequently do you send information to members of this group? 
(Ci rcle one.) 

12 3^5 

once a every few at least at least at least 

year months once a once a once a 

month week day 

How do you typically send information to members of this group? 
(Choose a maximum of three ways, ranking them with a J_ for the most 
frequently used way, 2 for the second, and 3 for the third.) 



Conversat i on 



Tel ephone 

_Correspondence or memos 
Reports 



Journa 1 s 



Books 

_Convent ions , profess i ona 1 
meet i ngs , conferences 

Abstracts , summaries 

Guidel ines , procedure manuals 



Other (spec i fy) : 



What type of information do you typically send to members of this group? 



f. To the best of your knowledge, for what purposes do members of this 
group typically use the information you send to them? 



T 



g. How do you determine how, or to what extent, they use the information 
you send to them? 
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C. The Role of Information in Crisis Situations 

Although our preceding questions have been concerned with ''typical' situations," 
we also are interested in what happens during the "crisis situations" which occur t 
from time to time in most jobs. Since there may be no such thing as a "typical 
crisis/' we would like you to think about the most recent situation you would describe 
as a crisis in your work. 

V 1. What was the nature of this crisis? 



2. To what extent did you need information from either within or outside of your 
work organization in order to deal with this crisis? (Circle the appropriate 
number for each . ) 

To a s ma 1 1 
extejht 

internal information 1 2 3 ' k 

Information from outside 12 3^ 

3. What specific types of information did you need in order to deal with this 
cr i s i s? 



To a large 
extent 
5 

5 



k. From whom did you attempt' to get this information? 
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a. Were you successful ! in getting this i nforr^at ion? 

Yes, completely'^ Yes > in part No 

b. If your success in getting this information was less than complete, what 
were the problems you\^ encountered? 



5* Assuming such crises will reocqur in the future, what might be done to 
insure that needed information's available? 



\ 

\ 
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Information Needs 



We would like you to consider your greatest unmet need for information . 

1. \*at type of Information do you need that you are not getting? (e.g., 
research, evaluation, performance data, bibliographies, state-of-the-art 
studies, etc.) 



2. For what purpose do you need it? 



3. From whom should this information come? 



How {by what means) would you prefer to receive this information? 



Opinions on Dissemination and Utilization 

K What do you think is the most effective way to Insure that the knowledge 
produced by research actually gets put into use? 



F. Pi ssemi nat ion-Ut i 1 i zat ion Process and Procedur es 

The statements below are derived from research 
and literature on dissemination and utilization (D&U). 
We would like you to rate the importance of each of 
these statements for the improvement of the D&U pro- 
cess generally. Having rated the importance of each 
item, we then would like you to consider how well 
such processes are presently handled in the area of 
human or social need which is most relevant to your 
work. • 



1. Collaboration and cooperation between researchers and 
users to find and adapt what is' useful. , 

2. Preceding utilization efforts by a full cycle of re- 
search, development, and evaluation. 



3. Systematic planni'ng of utilization activities. 



k. Selecting a competent' staff to implement change. 



2^ 

8. 

"9^ 



10. 

JT: 



12. 

TT 



16. 



17. 



19. 



Starting out with adequate financial resources to do 

the job. 

Stressing self-help"by those who are going to be the^ 
users of the research or change contemplated. [ 



Adequate diagnosis of the real user need. 



Involvement of informal leaders of opinion. 



Informal personal contacts with those who need to accept 
the change. 



Reciprocal feedback by both users and researchers, 



Adequate contacts by user with resource groups outside 
his own organization and referencfe group. 



Communication between levels in user organizations. 



Making sure users are clear about the purpose of the 

research and the ways it might be used. 

of the planning and implementation 



Careful organ! zat ion 
efforts. 



Encouraging resource groups to help users revise, 
adapt or draw appropriate implications from research 
f i nd i ngs . 



Generating. a willingness of users to change their 

behavior or listen to new ideas. 

Generating a feeling 'by users that the research findings 
would have high benefit for them in their work. 
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Minimizing frustration and difficulty encountered by 
users trying to adopt or adapt research findings. 

Coordination and teamwork within the user system. 



A concerted campaign to put the research Implications 

across. j_ 
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In your opin- 
ion, how im- 
portant is 
each of the 
fol 1 ow i ng for 
the improve- 
ment of the 
D&U process 
general ly? 



c 

0) 



c 



CLl 

E r 



To what extent 
are these pre- 
sently exemp] I- 
fied in the 
D&U activities 
In the area of 
human or social 
need wh i ch is 
most relevant 



To very high degree 


To high degree 


To moderate deqree 


To si ight degree 


Not at al 1 












































































































































































































Background 

1. Your job title: 

2. Organization for which you work: 



3. How long -have you: 

a. had this job? 

b. worked in this organization? 

A. Your age: 

5. eR Years of education completed or highest degree obtained: 



b. Field in which most advanced degree earned: 



\ 
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CENTER FOR RESEARCH ON UTILIZATION OF SCIENTiFIC KNOWLEDGE / INSTITUTE FOR SOCIAL RESEARCH / THE UNIVERSITY OF MICHIGAN 

ANN ARBOR. MICHIGAN 48106 



Our Center has undertaken an exploratory study of the ways In 
which new^ Information is used In the day-to-day operations of 
government and non-government organizations. The study has been 
undertaken with the cooperation of four government agencies which 
sponsor' a good deal of research and development (R&D) activity 
relevant to human and social needs. . 

^ These agencies are concerned that the research and development 
work which is done have some meaningful Impjact on program Improve- 
ment and on solving significant problems In the areas of employment^ 
education/ rehabilitation/ mental health/ and the social welfare of 
citizens of different ages. I think we all share this concern/ yet 
no one including tfie government has the certain knowledge of how 
R&D can^be communicated and utilized most effectively. 

This project represents a beginning Inquiry along these Vines; 
In the next few weeks we will be asking a small number of researchers/ 
administrators/ policy makerS/ and users how they now use new infor- 
mation In their working life. For this purpose/ we have developed a 
form in which we have set down some rather basic questions about how 
people use Information. 

We asked the staff of the Division of R&D Utilization of the^ 
Manpower Administration to select a cluster of 15 people In each of 
several work roles representing Important potential users or producers 
of knowledge. You have been nominated by them to be a participant 
in this study/ and we would be very grateful for your help. 

By this letter/ we want to introduce you to what we are doing 
and to pose a few questions about your Information using activities; * 
after you have had a chance to think about these questions for a 
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few days, we will send you a questionnaire form which focuses on 
these same question areas. I believe that the total process should 
be Interesting and thought-provoking, and that you wMl see the 
outcome as something of value to yourself personally as well as to 
the field as a whole. At least we will strive to make It so, and 
we will welcome your suggestions of how to do this In a way that 
Is most relevant and meaningful to you. 

When all of the questionnaires are returned to us and the 
results tabulated, we will return the summary results* to everyone 
who is participating in the study and we will welcome further re- 
actions from you at that time, also. 

With your help i think we can make a start at unravelling the 
problem of knowledge "utilization". Please call me collect at 
(513) 76^1-2560 If you have any questions about the project and its 
object lyes. 

Sincerely yours. 



Bonn I e Rami rez 
Project Coordinator 



Project Co-Directors 
Ronald G. Havelock 
David A. Lingwood 



BR: rw 
Enclosures 



*Your own Individual responses will be regarded as strictly coof I - 
dentlal. " 



'359- 



ERLC 



4 

ISR 



CENTER FOR RE'SEARCH ON UTILIZATION OF SCIENTIFIC KNOWLEDGE / INSTITUTE FOR SOCIAL RESEARCH / THE UNIVERSITY OF MICHIGAN 
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Enclosed you will find the questionnaire form we referred to In 
our letter of June 23^ 1972. We have Included a return envelope^ 
sel f -addressed and stamped/ for your convenience In mailing the form 
back to us. 

Your replies will be held In strictest confidence^ and you will 
not be Identified in any way In our analysis. The identification 
number on the top of the questionnaire Is only for our administrative 
use^ and serves to save you the inconvenience of further mailings. 

As we will be returning the summary results to all participants^ 
we would suggest that you make a copy of your own reactions so you 
can compare them with those of other people in positions both similar 
to and different from your own. 

We appreciate your participation In this study on knowledge 
dissemination and utilization and look forward to receiving your 
completed questionnaire form as soon as possible. 

Sincerely yours^ 



Bonnie Ramirez 
Project Coordinator 



BR:gh 

Enclosures 
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David A. Lingwood 
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ANN ARBOR, MICHIGAN 48106 



a 



We have not yet had a response from you or your 
office since mailing out the form on knowledge communi- 
cation and utilization about three weeks ago. We would 
very much appreciate your participation In the project, 
and would like to make your task as easy as possible. 
Therefore^ If you have encountered any difficulties, I 
hope ycTu will not hesitate to call ne collect at ^ 
(313) 76U-2550. In the event that this form has been 
misplaced^ an additional copy Is enclosed for your 
convenience* ^ 

S I ncerel y yours^ 



Bonnie Ramirez 
Project Coordinator 



Proj ect Co~D I rectors 
Renal d G. Havel ock 
David A, Llngwood 

RGH:rw 
Enclosure's 
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Telegram (Night Letter) 



WE HAVE NOT YET RECEIVED YOUR QUESTIONNAIRE RESPONSE TO THE KNOWLEDGE 
COMMUNICATION AND UTILIZATION SURVEY. WE STILL NEED YOUR PARTICIPATION 
TO INSURE VALID DATA AND WOULD LIKE TO HAVE YOUR RESPONSE AS SOON AS 
POSSIBLE. IF YOU HAVE ANY QUESTIONS Oi\ NEED A NEW COPY OF THE QUESTIONNAIRE 
FORM PLEASE PHO.NE MRS. BONNIE RAMIREZ COLLECT AT (313) 76i»-2560. 

RONALD G. HAVELOCK 
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A PROBLEM-SOLVING PACKAGE 
FOR DISSEMINATION AND UTILIZATION 
OF KNOWLEDGE 



David A. Lingwood 
Project Di rector 
Cente'n for Research on Utilization of Scientific Knowledge 
Institute for Social Research 
The University of Michigan 

June 6, 1973 
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THE D&U MODEL >ACKAGE ^ . ^ . 

INTRODUCTION, ' ^' " \' 

This is an outline for a process of problem-solving in tHe-are^of, 
the Havelock DSU model. It asks a system to develop an open, p^trci-fjat-ive 



method of learning about its DSU activities, and gives action suggesti9ns 
designed'to turn system introspection into creative change. 

We will begin with the prerequisites needed for. the activity (which 
may take months in large systems --if, indeed, it, can ever be finished). Next, 
you will be asked' to answer many questions about your system. These are 
divided into six steps. The last (seventh) step involves putting your 
learnings to use all of the work which goes before is meaningless w'ithout 
this step. 



c 



\ 



TKE SIX STEPS 

You will be asked to work your way through a series of six steps 
derived from a model of the ReD-D&U process developed by Havelock (Havelock, 
1972, and Havelock 5 Lingwood, in press). This is a model of the processes 
and, f unct ions involved in the production and utilization of scientific 
knowledge, rather than a model of st ructures . Thus, you will have to 
identify your own particular structures es they relate to the processes 
described. 

We will ask several questions in each step, and give you hints on ways 
to go about developing answers. Take ;^our time with each step, and don't 
short-cut to early solutions before you have gone through the whole process. 

STEP "0" PREREQUISITES 

You are about to begin an analysis^^ your R&D-D&U system which wMI 
require a great deal of hard work. You will need an extended period of 
time this task cannot be done in a meeting or two; you must be able to 
dig up information, bring to the surface and deal with opposing views, 
values and perspectives, and put It all into some usable framework. You 
will need support and participation of all levels of your system from 
highest policy maker to most remote client. 

Frankly, if you don't think you can muster all of the prerequisites, 
then you probably shouldn't begin. If you can't see any chance for open 
sharing and work for change, then stop here. 
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Trust, openness and change capacity can be developed, however. As 

( 

we go along we will suggest processes designed to ease this development. 
At the beginning you will probably need as much attention to how you are 
working as to the work products themselves. Frequent review of your processes 
(say at the end of each meeting) will be useful. 

As you go along you will begin to see things to changes to be made, 
new roles, tasks, etc. You will have to have the ability (top level support, 
time, staff, money) to get this work started.* Early failures may be overly 
discouraging to all involved. You might begin with changjes you are sure 
h^ve a high chance of succeeding. However, don't become overly dependent 
on such "incremental" progress a step at a time makes progress only if 
you are going in the right direction. 

You will also need the skills and capacity to integrate all of the 
results obtained. This not only helps you see how the pieces fit together, 
but allows you to identify the key changes which will bring other problems 
under cont rol . 



-367- 



STEP I : ' THE CLIENT SYSTEM 

We will begin analyzing your D&U s-ystem with those who are the targets, 
recipfents, or actual or potential users of the knowledge in it. The heart 
of the-task at this^p.oint is comparison between what you think' are the 
attitudes and behaviors in your client groups, and what they themselves think. 
Your "assignment" is to answer the questions below separately for e,ach of 
your important client groups. You will begin by identifying who these clients 
are. . 

SUGGESTED ACTION STEPS: Convene a group of 
people fromyour level to derive consensual 
answers to the questions below. At the same 
time, or immediately after you finish, bring 
together a group composed of teams from each 
of your client groups. Let them answer the 
same questions from their point of view. Next, 
get everyone together to compare results and 
work to understand (and build processes to 
solve) the differences in perceptions, 

1.1 Who are your important clients (people or groups who get services or 
information from you)? 

PROCESS: Write the name of each client group 
at the top of a large sheet of paper, one sheet 
per client, then answer tKe questions below 
separate ly for each cl lent group. 



FOR EACH CLIENT GROUP: 

K2 How does this client sense his own needs for change (any kind ^ 
that IS, anything not being done now)? )\ 

1.3 At a general level, what are the^ifTnost pressing present needs of 
this group? 

].k More specifically, how do the group's needs break down among the 
following types of need? 

1.^1 new capabilities (funds, staff, support, mandate, freedom, etc, 

1.^2 information (of any kind): 
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Within the information category, what are the needs for: 

1.^21 information based on research and/or development? 

1.^22 all other types of information? ^ 

Now, which are the ^'keystone** needs which must be met f i rs t? 
(Try to prioritize, or develop a logical flow of needsT} 

1.5 How does this client currently make known his needs for each area 
above (i.e., 1.^1,. 1.^21, 1.^22l~" 



YOUR EVALUATION 

SUGGESTED ACTION STEPS: At the end of each 
section we will ask you to move away from the 
facts with which you have been dealing and give 
your attitudes, feelings, or evaluations about 
what has just been covered. Often these will 
be in the form of scales o; other easily-scored 
items. We suggest you appoint someone to gather, 
score, and report back to you what you think. 
The same pe rson ojr someone else should then lead 
a discussion on the results and their meaning. 
If you are working in groups (e.g., managers and 
clients) prepare the results so as to compare 
what each group feels. These steps should be 
used consistently as you finish each section. 

You may find that, as you compare your work 
in the "fact gathering" and evaluation sections, 
you will want to move on to "OK, so what do we 
do about this?" This is natural, but it can 
Tead to premature action plans since you will 
need the results from al 1 steps in front of you 
to be ablie to do a complete job. So, try to 
keep the suggestions from getting out of hand 
in the early stages. Develop a system to record 
those which do come up for later use , make sure 
everyone knows of the system, then make ve ry 
sure you do refer back to the "file" when you 
begin developing solutions and actions. 

So far we have asked cyou for your impressions of the "facts." Now we want 

your opinions on the client systems you serve* 

PROCESS: If your clients have been involved, 
they should answer t,he questions from their 
point of view, looking back at you and the 
services you provide to them. They should 
concentrate more on El. 2 than on El.l, but 
should do some work on both. /^"^-s. 
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El.l What addftional clients should you have, and why? 

El. 2 Check the appropriate level of activity for your group vis a vis each 
of your clients for both activities below: 



Activity: 

Helping this client 
deve lop a capaci ty 
to sense and transmit 
his needs 

Actual ly helping this 
client become aware of 
needs he may not feel 
now 
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STEP 2: SENSING CLIENT NEEDS 



Here we want to turn around the analysis you've done so far. Before 
we were talking about needs of particular clients as you see them. Now we 
want you to think o'f how you as a group collect, synthesize, and make use of 
information from all your clients about their needs, 

PROCESS: If there are different "need-sensing" 
methods you use for different clients, you will 
want to continue the one-page-per-cl i ent approach 
used before. 

2.1 How do you determine what your client's needs are: 

2.11 quantitatively or through some formalized procedures? 

2.12 other ways? (Specify) 

jZ.2 How do your client's needs get transmitted to: 
■ ?.2 r — pol i cy makers? 

2.22 — administrators of service programs? 

2.23 administrators of RSD programs? ^ • 
2.2^ the research and development community itself? 



2.3 How do the needs transmitted to each of these three groups get handled? 
That is, do needs result in policy changes, new services, or R&O? 
Speci ft cal ly: 

2.31 How do policy makers respond to client needs? How open are they to 
what clients are saying? How much freedom do they have to make 
policies to meet needs? And at a broader level, what are their 
policies regarding the need-sensing process itself? 

2.32 How do program administrators respond to needs? How open are they? 
Is there a great deal of delay and red tape before needs can be met? 
Or, do they have the capacity to meet needs at all? 

2.33 How do research administrators respond to needs? How open ar€i they? 
Do they app roach cl i ent needs as useful gu i des to creat i ng re 1 e van t 
research, or see them as shopping lists or gripes not amenable to 
scientific investigation? Is there freedom to modify research 

^ lines. or broad programs to fit new needs? 

2.3A How easy or difficult is it to get rese.archers interested in working 
on topics related to client needs? What are the media available to 
'get, need statements to decentralized researchers? 
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2.^ What influence does your group bring to bear on each of the four groups 
above to make them more sensitive to client needs? 



YOUR EVALUATION 

E2.1 Check the appropriate level of activity, by your group or others as 
specified, for each of the client need-sensihg activities below. 



Activity: 

The activity of your group in 
gathering client needs 

The activity of your whole 
system in gathering client needs 

The activity of you r group in 
transmitting client needs to: 

policy makers 

program administrators 

research administrators 

RSD community 

The amount and quality of work 
each group below does in 
responding to client needs: 

^ your own group 

pol i cy make rs 

program administrators 

research administrators 

R&D communi ty 
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STEP 3: THE SOLbT I QN-BUl LDl NG PROCESS 

^ Now we want you to' consider the ways problem solutions, particularly 
those involving new knowledge, are produced in your system. 

3.1 Looking at the R&D knowledge used in your system, what proportion of 
that knowledge is produced by persons who are employees of the system 
(not including persons under grant or contract)? 

IF ALL R&D KNOWLEDGE USED IS PRODUCED OUTS I DE , GO TO QUESTION 3.2. 

3.11 Considering those R&D producers in your system, first, how do 
they decide (or have decided for them) what R&D projects to 

* undertake? List all the factors, forces, and people or groups 

who influence choice of projects. 

3.12 What does the leadership of research inside your system view as 
most important: producing science which is maximally acceptable 
to the scientific community, knowledge which is maximally useful 

in solving real problems among clients, or some mix of the two? 

/> 

3.13 List all of -the pressures and forces you can think of which 
directly affect the researchers inside your system in: 

3.131 assisting them to do cl ient-relevant work 

3.132 hindering them in doing this work. 



PROCESS: Make a sheet with two columns, one 
headed "Helping forces", and the other "Hindering 
forces." List out all of the forces you can 
think of in each column, then compare the columns 
when you've finished. 

3.1^ All In ail, does your system seem to reward or punish its scientists 
for producing client-relevant knowledge, or becoming involved in 
activities designed to commun i cate knowledge to users? 

3.15 Do the scientists inside your system have access to specialists 
who can. help them understand clients better and/or help them put 
knowledge into forms nrxist useful to clients? If they have access, 
do they use the people available? 
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IF ALL RSD KNOWLEDGE USED IS PRODUCED INSI DE YOUR SYSTEM, GO TO QUESTION 3. 

Let's consider for a moment those RsD knowledge producers outside of 
your system whose work you sponsor and/or use. 

3.21 How do you determine who the relevant R&D personnel are; i.e., 
those best suited to produce a given kind of knowledge? How do 
you become aware of new R&D talent, or personnel with whom you 
have never worked? 

3.22 How do you maintain contacts or access to outside R&D personnel? 

3.23 Do outside R&D personnel tell you what they want to do, or do you 
tell them what needs to be done (or if both, in what situations 
does each apply)? Do yib^\use RFP' s exclusively? 

3.2A How do you insure that results produce'd by outside R&D personnel 
will nrjeet the needs of clients? How do you influence or control 
applicabi 1 i ty? 

How much R&D have you sponsored to investigate the process of knowledge 
production, dissemination, and use itself? (IF NONE, GO TO QUESTION 3.^*). 

3.31 Were the needs for such work seen and supported by policy makers 
before the work was begun? What is the organizational climate 
or opinion about such work? 

3.32 How have these studies been utilized; what changes have resulted 
in the way your system does its work? 

3.33 What awarenoss and acces's do you have to the .commun I ty of scientists 
and other agencies who are also doing "research and action on' the 
knowledge product i on-d i ssemi nat ion^use process? How are you using 
the i r work? 

Considering all of the research knowledge produced and/or used in your 
system, is it available with a short -enough "turn-around time" so that 
it is still meaningful to cl iaents when the research is finished? 

IF NO: 

3.AI What, if anything, could be done to decrease turn-around time? 

3.A2. If turn-around cannot be substantially decreased, how might research 
planning efforts be increased or improved so that research done now 
may better anticipate what clients' needs will be when the results 
are in? 

(Compare with what you said about client need-sensing.) 



-37A- 



3.5 What is the current mix between basic and applied research in your system? 
3.5] Who sets the mix, or how Is it done? 
'3.52 Is there genera] satisfaction with the mix? 

3.53 Do applied R&D projects biuild from findings of earlier basic research? 

^ 

3.54 If your system has been moving to more^applied research lately: how 
do you insure your basic scientists wi 1 1 not be dropped by the 
wayside, and their more fundamental work ignored by the new trend? 

YOUR EVALUATION 



E3.t As you see it, what are the mo.st important problems with the research 
knowledge now produced in or for your system? . 



importance of problem: 



Not a 
Prob lem 



Overa.ll quantity of knowledge 

Overall quality of knowledge 

Basic/applied mix • . 

Sources (who is doing the work) 

Monitoring or evaluation of R&D 

Funds available to produce research . . . 
Extent to which results meet client need. 
Extent to which knowledge, once produced 
actually gets sertt to users . . . I 



2 

2 
2 
2 
2 
2 
2 



3 
3 
3 
3 
3 
3 
3 



k 

k 
k 
k 
k 



Very 
Important 
Probl em ^ 

5 
5 
5 

. 5 
5 

; 5 

5 



♦ 
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STEP ^: DISSEMINATION OF KNOWLEDGE j 

Once an item of research knowledge is produced, it must be translated for 
and transmitted to appropriate audiences. Here we will ask you to look at the 
translation and d i sseml nat i on act i vi t ies of your system. 

^.1. Know] edge t rans format ions : How much effort is put into: 

^.11 adapting R&D findings from the traditional s cien t i f i c medi a , 

e.g., journals and reports, to media the intended clients actually : 
use? 

^.12 changing the format and/or presentation of information to match 
the language of the client? \ 

^.13 ~" changing the type or content of information given to clients, 
e.g., by combining practical application information with the R&D 
findings? 

^.1^ What is your actual capaci ty for producing documents and output 
in all medi a? ' 

PROCESS: List all of the output media you use 
across the top of a large sheet of paper, then 
list the following down the side: funds available, 
printing regulations, mailing lists, technical 
experts, (etc.). Cross out the combinations which 
don't make sense, then fill in the ones which do^ 
with the information you have. 
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^.15 What is ypur capacity for storage and retrieval of information: 
e.g., indexing, search staff ,. computer systems, etc.? 

^.16 What' is your capacity for collecting or producing summaries^ abstracts, 
bibliographies, and^other guides to R&D* Information? Do these 
cover all knowledge in their field, or just the work 'you produce 
^ or sponsor? ' ^ ^ 

k,2 Know-ledge Transmission (Dissemination) : 

' Q ■ ^ 



I 



PROCESS: Answer the questions below^ for each 
of your important cl ient , groups . 
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^.21 As far as you know, what media does th i s c! lent actual ly use? 
For what types of information? 

k.22 How do you find out the above? 

4.23 What media are you now using to reach this client? 

4.24 How do you moni-tor the effects or uses of information you send 
to this cl lent'? 

4.25 How do you help this client to understand, adapt, test, Install, 
and make permanent the solutions he gets from the RsD knbwledge 
you send him? 

4.26 Now, -what are the most important pieces or types of information 
you think this client has gotten from you in the past few years? 
(Pick a more specific time frame meaningful 'to you if you can). 



SUGGESTED ACTION STEPS: After you have answered 
the questions for Step 4, convene representatives 
from each of your client groups (the same as used 
in Step 1, for example), and have them, answer 
the same questions from their perspective,. Compare 
the differences and discuss why the various groups 
see things differently. / 
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I ACTION STEPS: Again, have client representatives - 
answer the questions below. Then discuss differ- 
ences, relating evaluation to what was . sa i d in 
Step 4. 



YOUR EVALUATION 



E k.] Evaluate your system's work 
in each of the following 
actlvitiej's : 

Translating: 

from one medium to others 

using language of client 

expanding & including 

applijcation knowledge 

bui Idling gur capacity to output 
Information 

i ' . ■ 

Transmi tt ing: / ^ ^ 

US i ngj best medi a for each client 
determining client media preferences 

4, monitoring effects ] 
helping users adapt S adopt 



Aren't involved 
S shouldn't be 


Aren't involved 
but should be 


Are i nvol ved 
but not enough 


Are involved & 
doing enough 


Are involved & 
doing too much 
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STEP 5: INTERACTION , . * 

So far we have dealt with linkage between knowledge producers and 
consumers from a formalized and rather impersonal perspective. Many D6U 
acti-Acities Involve direct cont|dCi. between sources and users of knowledge 
however, so let's turn- to these "micro-system" opportunities. 



5.1 



5-2 
5-3 



H^at opportunities ar^ci procedures exist to foster the following 
kinds of interchang^^ between users and knowl edge ' p roduce rs : 



5.11 informal getAtogethers , phone consu 1 tat i on , correspondence? 

5.12 workshops , /semi nars , task-related rrieet ings? 



5,13 formal ipteract'on procedures - reviews, r^'.action menK)S, jomt 
supervision of work, etc.? 

. I ■ • ., ■ ■ 

Whb sponsor^ or instigates these; who monitors needs for them? 

What haye/been the most important outcomes of these inte rchanges? 

Are there, any combined projects or work settings (e.g., demonstration 
or pilot projects ,^ R&D-applJ cat I on pr*oj€;cts) in which both researchers 
and users are active? 

^.k\ Is participation equal and is decision-making shared, or is one 
nroup controlled by anoth^er? 



5.5 Are there any projects or progrc o^ work in which there is a high 
/priority on each group learning tr e perspective and ski ) Is of the 
other, ab^ove and beyond just gett ng the jot done? 



ERLC 



■379- 



YOUR EVALUATION 



E5.1 Give your opinion on the adequacy of opportunities for each of the 
fo 1 1 owi ng in you r sy s tern : 







Too 
little 




OK 




Too 
much 


a . 


Chances for researchers and users 
to ^et together informally 


1 ■ 


2 


3 


k 


5 


b. 


Chances for researchers and users 
to work together on joint projects 


1 


2 


3 


k 


5 


c. 


Chances for researchers and users 
•to exchange perspectives and skills 


1 


2 


3 


k 


5 



E5.2 Who (person or group other than your own) would you most like to work 
with on a joint project? 

5.21 What project? 

5.22 What would you like to gain from this? 

5.23 Why haven '.t you done this already? 
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STEP 6: RDD&U SYSTEM OVERVIEW 

For any complex system to function smoothly, someone must have a grasp 
of "the big picture": Who is doing what, and how do all of the parts. fit 
together? This overview is necessary for both planning and day-to-day 
operations. 

Who does the job of monitoring the whole system and building models 
of it? ' ' 

6.11 Is there sufficient capacity and Information to allow this job 
to be done? (s there t ime? 

6.12 Is the overview function formal and regular, or does the job 
get done only informally and infrequently? 

Once gaps are recognized, what mechanisms does the monitor have for 
starting work to f i 1 1 them? 

6,21 Is there the capacity to make changes seen as necessary? 

Who does the job of making all system members aware of the fact that 
they are part of a system, and where they fit in it? 

Who represents the whole system to others outsjde? 

6,^1 Does this person/group have enough accurate mformation and 
enough power to do the job wel 1? 

6.5 Who monitors other systems, learns from their D&U effort, 
and brings that knowledge back for use in our system? 
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6.2 

6.3 
6. if 



YOUR EVALUATION 



E6.1 To what extent does each of the 
state of affairs in your system? 



We are too busy caring for the 
trees to work on the forest. 

The "system'' isn't one - it is 
just a collection of unrelated 
things . 

Coordination of activities is seen 
as a threat to individuals and 
programs. 

We fill recognized gaps only with 
new programs unrelated to other 
act i vi t ies . 

Others see us as a coherent system 
with clearly stated goals and 
optimum programs to reach them. 



lowing statements reflect the 



1 

To no 
extent 

1 


2 ■ 


3 




To a 

great 

extent 

5 


















































y 




I 

1 
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STEP 7: NOW WHAT? 

The first step in building trial solutions from the work you have 
done must be to interrelate your answers to each bf the six steps, looking 
for "keystone" problem areas those which control solutions to other 
identified problems. 

We suggest you work as a combined group (e.g., providers and clients) 
to list the key problems in each step in a format like this: ? i 





Di ssemi nat ion 






Problem A 






^ Problem N 




Sol ut i on-Bui 1 di ng 


1 nteract ion 


The CI lent System 


r rou 1 eni H 


P r r»h 1 *a m A 
r 1 1 c 1 II r\ 

-> <- 


r roD 1 em m 

> 


Problem N . 


Prob lem N 


Problem N 




Need Sensing 






Problem A 






Prob lem N 




The System 






Prob lem A 






Problem N 






J 

Next , by consensus if 


possible, choose one 


area to start on. Pick an 


Important problem you feel 


you can be successful 


wi th th 1 s wi 1 1 be a 


shakedown of your problem-solving system as much 


as anything else, so don * t 



-take on a large, high-risk topic. 



FRIC 
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Next, go back to the file of solution/action suggestions you have 
been keeping, and use those which apply to the problem as a kick off to a 
session in which you design several alternative ways to solve the problem. 
From here on you must choose whether to put the solution into your normal 
channels, or to build some ad-hoc method to attack the problem. Whichever 
is chosen, assign some person(s) to serve as a monitor of the action with a 
charge to report back to all of you during the trial process. 

You should also develop a way of producing an archival record of 
your work, making sure the record gets to all levels of your system. 

From this point, it is difficult to make specific suggestions — 
each system will be moving to somewhat individual approaches to solving 
problems. However, keep the following in mind: 

--don't disband your group; keep it as a force behind your first 
solution trial, and re-convene it when this is finished to decide 
where to go next and how, 
--the skills and information you * ve gained are valuable; you should 
strive for official recognition of your usefulness in future 
change efforts . 

— monitoring and evaluation efforts should be developed for your 
own efforts, and the results fed back into your process. 

--if the comment above sounds familiar: you are beginning to see 
„that al 1 the steps you have been th rough may be appl ied to ahaly's 
of your group as an innovation, a need-senser, solution builder, 
disseminator, client helper, etc. 

--see your work as a constant course-correction process which must 
be repeated from time to time rather than a one-shot activity, 
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